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FOREWORD 



This program evaluation package represents an important scope of wdrk 
undertaken by seven member colleges of the National Postsecondary Alliance. 
The evaluation material herein has as its purpose program improvement. It 
is designed for use by institutions at the postsecondary level. It provides 
community and technical colleges with instructions for planning and 
implementing an evaluation program 'within their institutions, instruments 
for obtaining information from key sources, and procedures for their use. .A 
final section deals with preparing and reporting evaluation results,. 

The contributions of the representatives of the seven participating 
Allianoe colleges in. reviewing the material are greatly appreciated. These 
persons are Dr. Joseph M. Keller, Brevard Community Co lleg e; Mr. David 
Pipes, Caldwell Community College; dr\ Leon Jones, Midlands Area Technical 
College; Dr. Lillian Greathouse, School of Technical Careers at Southern 
Illinois University; Mrs. Mary Jolley, Trident Technical College; and Df. 
Dee Martin, Utah Technical College in Provo* m ■ % 

Appreciation is also expressed to Catharine Warmbrod, Program Evaluation, 
, Project Director;' Jon Persavich, Graduate Research Associate; and Ann Nunez, 
Research Specialist who served *as a consulting editor. Final edit was done 
by Brenda Sessley in the Field Services Division. tTheir contributions to 
the project are reflected in this book- 
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Executive Directdr ' 



EXECUTIVE SUMMARY 
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This book was prepared to present an evaluation package that can be 
uti]ized to evaluate postsegondary occupational education programs, at the 
local level* These mateVials are designed to gather information from the 
following sources: consultative teams, advisory committees, administrative 
and supervisory personnel, instructors, students, and employers, 'tach 
chapter that deal»s with these sources .of /information contains the following 
subsections: Goals and Objecti ves--def ines potential outcomes of that 
particular aspect of the evaluation process; Procedures for ' 
'Administration—provides a suggested step-by-step sequencing of *the tasks 
leading to the accomplishment of the objective; Procedures for' Data 
Analysi s--presents a suggested fnethod for organizing the information gained 
into valuable data; Model .Instruments and Documents— contains sample r 
instruments and documents that have been developed and field tes.ted. Two 
additional chapters, one deal4j3g~with cost analysis of occupational 
education program^ and another with preparingand reporting evaluation 
results, are also presented* ^> * , 



CHAPTER ONE 



INTRODUCTION 

■» * 

Evaluation of educational^ programs is essential to determine their worth 
and to'provide for their continued improvement and effectiveness. Although 
postsecondary institutions gather much data to meet state and federal 
evaluation requirements; there has been a need for an eval uation .system 
\ designed for use^t the postsecondary institutional level. 

To meet this need, seven member colleges of the National . PQStsecondary 
• Alliance sponsored a project to survey existing material and to select from 
this the best anjJ most appropriate material, for their use. Ttris book 
contains that material ,, providing a system, implementation procedures, ^ A 
instruments, and instructions. Users are encouraged to further adapt arid 
modifythe materials to their particular institution. - 

The word evaluation has many different meanings depending upon the need 
it i,s designed to meet and whether the focus is formative or summative, 
process or product. The working definition used here is as presented by 
.Wentling (1980). He defines evaluation's: . . 

The collection of information and judgments to facilitate 
planning, to aid in the improvement of programs, and to meet 
accountability demands. 

Went1'ing^( 1980) further identifies five outcomes of evaluation that are 
significant to the postsecondary institution. They are planning, decision 
making, professional development, program improvement, and accountability. 

1 . Planning *^ # 

'Evaluative information that provides measures of resources, 
TimUat ions,* and poss itH^I i t^sH s-es-sent-i-al i n-estaM-i^+iing — — - 
and assessing objectives and is useful in planning. Such data 
can help instructors determine the worth of an existing scheme 
or plan by revealing-its reasonableness and goal achievement 
level > 

2. Decision Making < / 

Decisions, regardless, of their magnitude, must be based on a 
* certain amount of information. Decisions regarding assignment 
of personnel to programs; selection of students; program * 
changes, additions or deletions; and those regarding the, 
selection of alternati ve'proposal s may all require some justifi- 
. cation. One manner of arriving at defensible decisions is 



to gather objective evidence that support the decided action. 7 
Decisions based on intuition alone are often difficult to justify 
whereas those ba^secT on evaluative information, are often more 
defensible and justifiable to program staff, the administration,, 
and the underwriters of public ,or private instructional programs. 
Evaluation information* not. only aids in decision making. but in 
decision justification* „ . * 



V 

V 



3* Profess ional- Devel opnjent 

• • : ^ — ' , r - - . . 

Evaluation 9an benefit instructional;'or H ancillary personnel. 
A- comprehensive, evaluation ^system that tdfentifies de* • 
ficiencies and strengths in personnel performance will be 
helpful, in promoting desired behavioral^anges. Many times 
the eval uapbn' of faculty is conducted o'flly to bestowtenure 
antf promotions or .to jneet governing board mandates. However, 
staff performance is probably the most important contributor 
. to the success of a program, and evaluation is invaluable to the 
improvement of this critical element. Not only wilT evalua- • 
tion work* to upgrade evaluated staff, ..bat staff members wfro are 
involved in t^e evaluation and -its procedures wiTUgain a 
■ measure of evaluative expertise to helj)^them plan and evaluate *. 
their own activities.. In this .respec # t, participation in evalua- 
x tigrt is viewed as a prpfessional devel opment ^activity. 

. Program Improvement * 

Evaluation-of programs will nearly always contribute to better 
service for students, if the evaluation offers both 
value judgments regarding what is happening within the program 
*and. consultative suggestions for program improvement.- The ' 
• improvement of programs and offerings is the most, important * 
1 gosl that evaluation can assume* To supply Information for 
% planning and decisionmaking and to assess the current program 
the eval uation 'activities' should identify tractions \ compo- 
nents, or characteristics thcit promoted desired or undesir?d 
outcomes ..'J)nce program deficiencies have, been identified,.* 
corrective action may be taken.. Processes or components that 
have beer], found to .contribute to a program's success may be 
adapted to other programs or to other portions of the same 
program. v , • ~ ~. • 



Accountability 



r 



Both the private and public sectors demand Evidence that r 
current educational* programmi ng outcomes are worth 'their 
investment. Just as^Wall Street brokers asstess a return ' 
on. their investments^ the taxpayers" and the [stockholders ' 
evaluate their investment' in publ ic~and pri^rte education. 



Educational accountability requires a presentation of pn^ram 
results (§ug-. , placement of students in jobs, achievement 
scores, increased sales, more*effecti ve management) ' in rela- 
tion to incurred costs and established objectives. From an 
internal perspective these 'accountability measures can aid 
program managers and administrators £y helping to justify 
their decisions regarding the expansion, deletion, or 
revision' of existing programs. A wel 1 -conceived evaluation 
program or system within an education or training institution 
helps , meet this accountabil ity requirement. 
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CHAPTER TWO 
THE EVALUATION MATERIALS: AN OVERVIEW 



The evaluation materials presented an this document are patterned after 
and-contairv/sections taken directly from Project 1EAP (loca.l Educational 
Assessment* Program) which was developed at a postsecondary institution, the* 
Athens Area Vocational-Technical Schaol. Project LEAP jwas funded by the r 
Georgia Department of Education , to provide institutions with' a mechanism 
for improving the educational process for the' institution, the programs, and 
the individuals involved. 

f 0 

The evaluation materials presented here are intended to be: ' , 

• n comprehensive M --encompa$sing perceptions from all 

segments of the educational community; 

• "cycl ic" — al lowing for continuous assessment of 
( nedds and' continuous growth activities; 



# 



"val id"--one that was based on the modification of proven , 
assessment instruments and techniques;^ . 

'"usable"— exportable and implementable by 'current, 
staff; ~ ' 

"userftn "--meeting the accountability requirements o'f 
federal, state; and local demands— and providing 
institutions a mechanism for improving the educ\a,tiona4 
process for the institution, the programs, and the 
individuals. „ 

tin using these evaluation materials, information may be gathered fpom 
cme\r more of the following primary sources; consultative teams, advisory 
committees, administrative and .supervi sory personnel , students and ' . 
employers, and instructors. Each primary source is the focus of an 
individual -chapter within this document. These particular information- 
gathering chapters are internally organized into the following four 
sections: 

1. Goals and Objecti ves— defines potential Outcomes of t„hat particular 
aspect of the educational process. # «J| 

Procedures for Admini strat ion— provides a suggested step-by-step 
seqiiencing of tasks leading to the accomplishment of the objectives. 

3. Procedures for ..Data Analysi s— presents a suggested method for , 

organizing .the information into usable data. wW 

• 



r 4» Model Instruments and houmuTits-'-cmtdin copies of instruments unci 

document* that have been developed and fie«Id tested. . . - 

, ^ Additional chapters are given 1.0* utilization of the materials , 
instrumentation and interviewing, c6st-ana1ysi s ^valuation, and finally 
preparing and reporting evaluation results. 

' ' 1 ' 

-** -~ ~ ^,A1 1 materials are designed to assist the local institution in organizing 

and^el iveririg an evaluation method that produces institutional, program, 

and individual improvement in the educal lonal process.. Lach institution is 

e ncouraged to modify or a d apt this material in order to meet its individual 



. , . • CHAPTER THREE 

* v \ ' . UTILIZATION ; • 

• V • • ■* 

faculty and Staff Involvement . 

The following are key factors to the success of the evaluation process: 

v 1. The purpose of the evaluation must be emphasized. This material 
' * )>is designed to allow all staff to participate in activities, 
* that are of direct benefit to them and their students. It does 
not exist to eval uate-v-teacher performance relative to job tenure 
or promotion, *• - * 

I. Staff commitment to using the model and their understanding of the 

procedures and responsiblities involved in the total process are /I 
necessary. 

3. It 'is essential that faculty be represented in all planning 

committees related to the program, faculty should participate in 
fhe selection of external evaluators, i n. schedul ing , in modifying 
or developing i nstrumemts , and^ most, importantly , in identifying 
needs - . - . 

V 

Only by full participation and open communication can, an evaluatiorv 
program develop the idea" that ''we" are doing this. The process of faculty * 
orientation and involvement cannot be overemphasized. 



Some suggested avenues for faculty and staff orientation are as 
.follows: . * 

o Through inservice meeting-s 

o Through general faculty meetings 

o Through divisional or departmental meetings 

• * ✓ J 

o Throligh individual conferences^ 

Local Neetfo 

ih^se^ material s aTe designed to apply to a broad range of vocational- 
technicaM nstitut ions. PHor to the implementation of any segment of this 
material , a faculty-administrative committee should revjew all components, 
including objectives, procedures, sample documents, and instruments and 
Should make appropriate modifications. 
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# • Loca l Organiz ation an d Data Hqw 

- ' • * . ■ 

Local personnel responsibilities must be defined by each institution 
when adapting and implementing this or other assessment-development 
materials. The Data FJowChdi' depicts assessment phases (Sample Document 
1 ) • 

In phase one, Negds^ Assessment; an individual, identified as the' 
institutional represent * t'we, shnufd be assigned to coordinate the 
assessment process for each data source. In a second functional phase, Data 
^.Analysis and Syntluisi c one pei son is assigned the responsibility of 
receiving, organizing, and maintaining data in a format that relates to an 
individual or .in instructional program. A second person should be assigned' 
accordinylv for those, institutional needs that are identified. The third 
phase, Personnel, must >v* priority needs, develop improvement plans, 
implement those plans, and evaluate the nesults. Personnel consists of 
instructional supervisors and t-heir instruct ional staff or the institutional 
director/designate and appropriate staff, / 

./ 

Although institutional representatives are selected to implement each 
information gathering phase of the evaluation effort, an evaluation 
coordinator should be selected to coordinate the comprehensive institutional 
effort. T\his person would oversee the project and be available to the 
institutional representatives for guidance. "The evaluation Coordinator 1 s m 
responsibil itfes would include seeing that each activity is conducted at the 
appropriate time, that the flow of information is appropriate, and that 
^activities are conducted in a manner'consistent with the objectives of the 
program. In essence, the evaluation coordinator would. have the 
responsibility of assuring that the total evaluation is/ properly conducted. 

*• - ' Is . 

Component Utiliza tion " 

f t - 

The materials presented in th is document are designed so that selected 
chapters may be used individual ly or in uni son with the total system . Ma ny 
times, rather than conducting a comprehensive needs assessment, supervisors 
or administrators identify specific operational needs or have "hunches" 
regarding potential or existing problems they Wish to assess. In cases such' 
as these, specific components of the assessment design can be selected to 
verify or identify the same. 

Logical sequencing dictates that certain components be used at certain 
times. For example, annual follow-up activities should be designed to occur 
after graduation; student perceptions should not be assessed during 
students 1 first 'week of attendance. The Calendar of Events (Sample Document 
2) provides a suggested schedule' for implementation of arp evaluation 
Pfocess'. , * 



♦ I * 
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Data Assimi latioh 



It is imperative that the local institution deTfne a specific procedure 
w.thP L^imilation of data. AT 1 institutions constantly generate usable 
d f °a r ta Tut "few nave an Sgarflzed System that allows data to be pulled together 
and used for planning or improvement practices. 



Staff and- Program Development 



Early in the. eval uation process It must be recognized that improvement 
is the prim ary goal . One should not let assessment become the primary goal. 
ALessmenn^important, but only to identify needed improvements. 

- improvement activities should be focused on those needs contained on 
the a op m Ne^ds Analysis Piffle. Both the Improvement activities and 
the Evaluative criteria used to fudge successful completion of the 
imurovemen-t activity should be based on mutual agreement between the 
ndividual responsible for the activity and the immediate supervisor. 
iTStTnt nnint is that through a cooperative effort, the institution 
T^olet fSe progr^m improves, the individual improves, and the students 



The 



benefit- 
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Sampfe Document 1 

DATA rtoW CHART 




Sample Document 2 

CALENDAR OF EVENTS 
for Implementation of 
EVALUATION 



ACTIVITY 


Oct. 


Nov. 


Dec. 


Jan. 


Feb. 


Mar. 


Apr. 


May 


June 


July 


Aug. 


oepi. 


1. Consultative Evaluation Teams 


X 


X 












+ 










2. Student Perceptions 








X 










■ 








3. Instructor Perceptions 










X 






— , - 










4. Administrative and Super- 
visory Perceptions . 










< 


X 


- 










r 


5. Accumulate Extant School 
Data 














i- 


* 










J3. Cost Analysis 








■ 


* 




X 












7. Analyze and Synthesize Data . 




v -./>«-, t 










X 


X 

r i 


t' 








8. Needs prioritized and 
objectives established 










* 


- 


X 


X 










9. Develop Improved Contracts 














X 


X 






• 




10. Improvement Activities Begin 










< 


- . 








.X 


X 




11. Follow-up Activities 


X . 


X 


X 


X 


X 


X 


X 


X 


X 


X 


. x 


X 


12. Evaluate Improvement 
Activities ^ 














• 








X 


X 
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CHAPTER FOUR - 
INSTRUMENTATION AND INTERVIEWING 

* < 

' Appearance and Design of Instruments 

Wentling (1980) gives suggestions for developing and modifying > • 
evaluation instruments. To attract and hold attention, instruments must be 
visually appealing, readily understandable, and easily completed. Research 
has shown that the following factors dffect the return rate of mailed 
questionnaires: ■ • 

1. Appearance of the instruments 

a. Attractive design and typing of. instrument are important. 

b. Good quality paper, preferably colored, should be used. 

2. Design of the instruments 

a. The instrument should be brief and allow for easy completion. 

b. The directions should be concise, complete, and placed close to the 
items so that the respondent will not have to flip back and forth 
through the questionnaire. Set off directions with- heavy, 
distinctive lettering.' _ 

c. Questions with similar types of responses should be grouped * 
together. Tor example, place questions with check-type responses 

. together and written comments together. 

d. A deadline or desired return date should be given- 

. e. The mailing address for returning the instrument should* appear in 
plain sight. 

f. A stamped, addressed return envelope should be included. 

g. Sufficient space should be provided for responding to each 
question. 




H. The follow-up letter should i^-oigned by someone held in high regard 
by the respondent.' 

I. When second notices are mailed, send an additional questionnaire. 

j. Tor aid in tallying, instruments should have a rating v scale if one 
can be appropriately applied. ' . 
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k. The same rating scale should be meet with similar instruments to 
keep the results val id and interpretable. v * 



The following interviewing guidelines are cited in the "Locally Directed 
Evaluation—Illinois Office of Lduoition" (Illinois Office of Education, 
1976) and given a$ suggestions when appli.cabTe. 

Interviewing is a basic assessment method. ^An interview is not just a 
conversation; it is, rather, a carefully thought out technique for finding 
out from respondents how things are and how people fee.l and think. The 
interview itself is not intended to change or influence the respondent. The 
interviewer, therefore, must be an understanding person, capable of accept- 
ing what the^ respondent says without Judging or rejecting. 

a. The respondent needs to see the interviewer, as someone 

who is not a threat to his/her immediate or future . . 

well-being, nor to h-is/her self-esteem. 

b. _ The respondent needs to see the evaluation itself as 

not posing a tjbreat. 



c. The respondent needs to understand, even in a limited 
way, the •purpose of the evaluation, the reuso-ii for 
selection, and the necessity for cooperation*. 

d. The respondent needs to see the interview situation as 
a pleasant way of spending some tu.ie. ' - 

e. The respondent needs to feel, after the interview is 
completed, that it was a real opportunity for free « 
expression on a particular 'subject. 

To meet these needs of the respondent, the interviewer musjt be 
conscious of the style and the content of the interview. The following are 
suggested techniques that help to ensure v a good interviewing relationship, 
as well as to obtain an accurate, unbiased interview:- 

a. Be -friendly and informal but at the same time, 
professional . , . 

b. Be a sympathetic, interested; and an attentive listener. 
Be neutral with respect to the subject 'natter. Do not 
express your own opinions either- on the subjects being 
discussed by the respondent or on the respondent's ideas 
about those subjects. 



Principles of Interviewing 
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Be observant. Be alert to the respondent's manner of 
expression and use of gestures . „ - 



Last, but not least, be at ease yourself, in ttie interview 
situation. If you feel hesitant, embarrassed, .hurried, or 
awkward, the respondent will soon sense this feeling and 
behave accordingly. 




CHAPTER f IVE . ' / • - > « 
* • / 

CONSULTATIVE TEAM EVALUATION 

/ . . * > . 

This chapter is divided into four sections/and provides a methodology 
for the evaluation of occupational programs, by persons extegial to the 
educational institution. The sections "are Wal s and Objectives, Procedures 

/for Administration, Procedures for Data Analysis, and Listing of Sample 
Documents. Implementation phases, previsit/, visit and post visit are listed 
under Procedures for Administration. Samale documents and instruments used 

* in gathering the evaluative data are included. J 

• /• . ' 

/ 

» / * 
Goals and Objectives 

Goal 

* * 

To have occupational programs evaluated by appropriate persons external 
to the educational institution. f 

* 

/ 

Objectives 

The foil owing.* are objectives of consultative team evaluation: 

} : 

1. To provide data for valid program development activities 

2. \$ identify needed curriculum improvements 

3. To identify needed ^changes or modifications in physical 
facilities , ; 

4. To identify instructional equipment needs , 

5. "To identify need£ in the learning resources area 

6. To provide data relative to decisions in expenditure of , 
funds 

7. To compare business and industrial standards with institutional 
and occupational program standards . 

8. Inform, involve, and utilize expertise of representatives 
from related business and industry 

. 9. Inform business and industry about the institution and the ! 

Otcdpational vprogram' - 
• 10. Improve job placement opportunities for students 

11. Identify future occupational trends 

12. Identify any existence of sex bias 

13. Identify unmet needs of disadvantaged and handicapped 
students 
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' Selecting the institutio nal Repre sentative 

Prior to the commencement af any evaluation activities, the institution 
should designate an institutional representative to be in charge of 
administration of this component. It is recommended that the institutional 
representative be an administrator or supervisor, be familiar yith and 
engaged in. the day-to-day 'operati on of the occupational, programs and 
-services, and be able to devote appropriate amounts of time to the§e 
^responsibilities- 

* 

. Determining the Composition of the* Team ' ' 

To ensure-that the institution's instructional program is current and in 
keeping with the occupational needs of the community, representatives from 
local business and industry are invited to participate in a consultative 
team evaluation for each occupational program. Local representatives who 
serve on a team should meet one or more of the following criteria: 

. Familiarity wttR the philosophy, principles, and concepts 0 
of occupational education ' 
t Current employment in the occupational area 
t Seryice as an advisory member at the local level 
• Knowledge of the requirements of the occupations 

for which training is being offered « ,^ 

The following two groups of individuals are proposed as possibilities 
for inclusion on an Evaluation team: 

1. Required. Repr es entation 

a. Specialists or experts presently working in the occupational 
field • 

b. Employers of graduates > 

c. Former Students or Graduates employed in the occupational 
field. 

. j ' * • 

2. Recommended, But Not Required , Repre sentation ' J - . 

a v Education and training professionals 

b. Interested citizens not covered by other categories * 

c. Mertibe\s of the governing board, general advisory boards, and 
craft advisory boards 

*d.. y Members of the local chamber of commerce 

The number of team members should be determined by the scope and focus 
of the evaluation. The institutional representative, in conjunction with* , 
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the instructional coordinator of the program being evaluated, should make a^L.^ 
judgment as to size of the team necessary to accomplish the objectives 
of the study. Some considerations on -the size of a team are number of 
faculty, number of student s\' and the amount of time to be deyoted to the 
actual visit. : ' ' s^l^. 

It is recommended that a new slate of team ^members' fie selected each time 
the r i nsti tut ioa undergoes a consultative team 'eval uation? 1 This wouTd avoid - 
undue imposition upon the time' and talents of any person and get new input 
each time from different team members. », . 

* <fc ^ • ■ 

Determinin g the Scope of the Evaluation 7 . 

* " " 5 ■ 

The scope of tRe consultative team eval uation wi 1 1 vary, with different- * 
institutions. Some considerations when determining scope are (1) to keep 
the range of activities within limits of what the team could be expected to 
study, observe, and evaluate in the allotted time and (2) to ask the team* 
only to study, "observe, and evaluate areas in which the member^ |puld have 
expertise. . 
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The following areas would be appropriate for the consul tat ivejteam ^W- 
evaluation: . " „ v ^/ 



1 P hysical Facilities ': To -include such factors is soace^ 

adequacy, organization, light, heat, ventilation,- noisf 7 level , and 
safety considerations 



2. Instructional Program : To include course content g^itefn, course- 
sequencing,, gourse emphasis, organization, rel evan|j|||^|^ 
departmental orientation programs ' „ 

1. Equipment : -To include such factors 0 as a-pprppr^|tenes^|uantity^ 
. and operational condition of the instructional equipment within the 
respective program 

4. Suppl ies : To include quality, quantity, and availability of gjj 
suppljes essential for effective instruct ion 

6. Instructio nal Materials : To include handouts, audiovisual s , 
. reference materials-, and -Gt her materials needed for -effective ; 
instruction - 

6.. Upgrade Training : To' include the need for addition, deletion,- or 
change of short-term- upgrade courses currently offered by the 
institution, either through on-campus or extention services . " 

/. Sex Bias and Racial Bias : To identify any existehce of sex or ' 
racial bias in a- program ' . . . * 



19 

25 & 



/ 



•v 



8#.' P.i.Sjat PShtaqe d' and Handipggped: To identify arty unmet* need S' 0/ ' 
disadvantaged and handicapped students 



* Pre visit f*jsepaVation ' f < . -« 

•J* M * • - • 

The following dixies are the responsibi H ties of and shoul^ be conducted 

*v#?by the persons indicated L>elow^ ' 



1 . ^ustituti^ftal Repreljffitati ve 's R evisit Responsibilities 

a. Helps familiarize those involved in the evaluation process with 
the procedures and concepts of the evaluation' and works toward 
a commitment from them. ^ 

b. Emphasizes to tho^e inwlvlti i.ri the evaluation process that the 
team members are -Jiving their time and expertise to help the 
institution and stiould be treated in a cardial and cooperative 
manner. : ^— 1 

c Familiarizes hims^l/hersel f with the various manuals, forms, 
instruments »"Str1frand is available for any explanation' to 
tho i se"who r Will be u$in.g these materials, - 

d. . Reviews with department chairperson and other local 
personnel the instruments and documents and makes changes or 
modifications based upon specific needs. 

e. 'Works wittl, appropriate institutional' personnel in arranging the 
date for the team visit. ; 

f* Mails ja^ each ^eam member a packet of materials thai ineludes: 
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*U)V^^nf irm^tl'on -letter (Sample Document \) with-- - • 
?' o reporting time, date, and destination, /( 

* o schedule; ■ 
v o packing provisions, 

- o* invita v tion A to Tunch (i*f -appropriate); 
* fi ~(2) list of duties for the team members (Sample Document. 2}? 

(3) sample copy of the Consultative Team' Evaluation Report 
. (Sampl* Document 3); 

■ ' ' - - ■ ) 

(4) 'curricula outline; / 
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(5) list of short-term courses taught on an annual basis * 
% ' related to the occupational program-. 

2 K Program Chai roefsfrn's Previsit Resp onsibilities 

a. Submit to the institutional representative 'a list' of prospective 
team" members. The team members should have, expertise, in the 
occupational area so that 'their review, assessment, and recom- 
mendations ^1 1 1 be meaningful to the program. The chairperson 
contacts prospective team members, and requests their 
participation on the consultative team. 

' b. Transmits to the institutional representative a copy of the 

curriculum outline t"o be sent to each team member prior to the 
visit. * . • 

c. Informs students in a* positive manner'of the schedule, date, and 
purpose for the consultative team evaluation. 

d. Alert students to the possibility of an interview. 

e. Arranges meaningful learning experiences for students whi.le they 
are "a part of the consultative team. 

f. Verifies that required representation is included on the 
confirmed consultative evaluation team. 

g. Transmits the names, addresses, and business affiliations of 
those agreeing to serve as team members to 'the institutional 
representative. ' - ( 

3. Consul tati ve Te am.' sJ^evisU Responsi bi 1 i ti es 

a. 'Studies the curriculum outline of the program to be evaluated. 

b. Compares the curriculum being taught with needs of business and 
industry. ' 

c. Examines the consultative team evaluation forms that will*be 
• used as a guide during the actual team visit. 

• Visit Preparation ' - . 

The amount of time designated for the visit depends upon the si?e*of the 
program' being evaluated. After the team's- observation and study.. each team 
member is asked to meet with the institutional representative. Thereafter 
' the team members may complete their consultative team evaluation reports 
(Sample Document 3). Or if they desire, they may return for- more ■ - 
observation and study of the program. This schedule will vary-according to , 
the .schedule of the team members. 

... ,21 • • 
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The following activities should be the responsibility of and conducted 
by the persons indicated: 1 

1. Institutional .Representative's Visit Responsibilities 

a, fleets with the team members for a brief orientation prior to 
entering the program area: 

(1) Serves refreshments during a brief "ice-breaker" social-, 
if appropriate, ' 

(2) Supplies team members .with appropriat^inaterial s (paper, 

pen, name tag, report forms, etc.)* 

*" ✓ • 

♦ 

,(3)' Familiarizes the team members with the schedule 2nd 
: procedures for the visitation and reviews the Evaluation 

forms the team members will be completing, 

(4) Encourages all team members to stay for th^ir contribution 
to the summary report that is compiled by the 
institutional representative from. individual reports* 

(5) flsks the team members to interview all instructors and 
randomly selected students during the' course of the visit, 

b*. Introduces all instructors and^he team members before the team 
begins its observations and interviews. 

c. Gives a brief tour of the departmental facilities to the team 

members. 

d. Monitors the progress of the evaluation team to determine^ that 

activities are proceeding as planned and acts ^s a resource 
person. 

e. .Chairs the summary conference with the team as defined under 

' data analysis. Works with team members who have extenuating 
circumstances concerning the visitation time and/or schedule, 

f. Works with team members who fcave extenuating circumstances 

concerning the visitation time and/or' schedule. 

2., Instructors 1 Visit Responsibilitie s ' 

. a. Should be prepared to provide additional curriculum 

materials—course objeqtives ?N lesson plans, audiovisual 
instructional materials, reference and resource materials, 
t supplies, and instrOctional handouts. 



22 

28 



b. Should be prepared to answer questions concerning any aspect of 
the program, curriculum, equipment, physical facilities, and 
learning resources 

3. Consultative Team's Vis it Responsibilities 

a. Meets with the institutional representative in -charge of 

evaluation for orientation prior to entering the program area. 

b: Examines- the program- curriculum and .objectives to determine if 
they are consistent with occupational needs. 

c. "Examines teaching material^, supplies, and equipment being- used 

in the program. 

dl Makes an effort to contact all program facujty members and as 
.many students as possible. . 



Records comments and observations on the consultative team 
evaluation report. ' 



f. Meets with the institutional representative for tjje summary 
conference .to discuss the visit, review and assess the . 
' findings, clarify any ambiguous responses, make recommendations, 
and submit individual reports. ' 

Postvisit Activities . — ^ 
- Institutional Repre sentative's Duties . » 

— J ~~ > 

a. Promptly sends a th.ank you letter (signed by the director of the 
institution) to each team member (-Sample Document 4). me 
institutional representative may desire to solicit ^he aid of 
program staff, in accomplishing this. 

b. Prepare a writtewresponse to each, team member indicating plans for 
and progress toward implementation of the teams recommendations 
(Sample Document 5). 

- • Procedures for Data Analysis 

• The -purpose or this section is to organize the data gathered through the 
team investigations into an understandable and usable format. 

TncHtuHgnal Re presentative's Duties :- 

1. Chairs the consultative team evaluation summary conference, serves 
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as a liaison person, gathers all data and report s^from team members, 
and gets clariticatiofts and interpretations where needed, 

• 1 r 

2. Prepares a consultative team evaluation thank you letter (Sample - 
'Document 4) after the team has left the premises. 

3* Conducts an institutional summary conference' with all concerned 
personnel, such as, director, program chairpersons, coordinators o v f 
student personnel services, and instructors. 

4, < Refers the accumulated data to the person designated to complete the 
"program needs profiles/ 1 

Data Utilizatio n • . 

The primary purposes of this total evaluation model is (1) individual 
improvement, (2) program improvement, and (3) institutional improvement. In 
order for the data gained from .the assessment "process to be meaningful, tfoe 
data must be used. IT IS EXTREMELY IMPORTANT THAT ALL CONCERNED PARTIES BE 
INFORMED OF THE RESULTS AND THE IMPLICATIONS FOR IMPROVEMENT. 



Consultative Team Evaluation Flow Chart 

, The Consultation Team Evaluation Flow Chart on the following' page 
summarizes the process used to accomodate the consultative team evaluation 
within the inst;itution v , 7 
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CONSULTATIVE TEAM EVALUATION FLOW CHART 
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LISTING OF SAMPLE DOCUMENTS 



Document Number . Document Name 

1. % Confirmation Letter , 

2. Team Member Duties 

3. - Consultative Team Evaluation Report 

4. Thank Y-cru Letter 

5. Follow-up Letter and Progress Report 

6. ^Consultative Team Evaluative Summary 

Report - 

?• . Alternative CQnsultative Team Program 

Evaluation Instrunftnt 
« 

8* Assessment Profiles for the 

Alternative Consultative Team 
Evaluation Report 
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Sample Document 1 



CONFIRMATION LETTER 



Dear Mr. /Ms.: % " 

Thank you. for your positive response regarding the Consultative Team ' . 

Evaluation of the , Program of. this 

institution. Your services will contribute to the occupational preparation- 
offered at this school. 

# 

Enclosed is a packet of information concerning the role and duties of a 
consultative team evaluation member and also a description of the program 
you will be helping to evaluate. Please review this information prior to "the 
visit. p t 

As previously 3i scussett>4he meeting" is scheduled for 



Your interest in vocational education by agreeing to 



serve as a team member is appreciated. Your participation and involvement 
in all activities is encouraged. It is especially important that each team 
member stay for the entire session and have his/her contributions included 
in the summary report. 

If you have .any questions after examining the materials', please telephone us 
at . We are looking forward to working with you. 

-» Cordial ly, 



JD/ije 
Enclosures 



John Doe 

Institutional Representative, 



NOTE: Parking provisions and reporting destination should be jl part of .this 
letter. / ^ , 

If an invitation to lunch is given, it should be a part of this 
letter. 
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Sample' Document 2 



CONSULTATIVE TEAM MEMBER DUTIES 



Consultative Team Evaluation 

A program'evaluation involves the visitation, observation, and-analysis 
of an instructional program by. a team of individuals with expertise in the 
area and with the purpose of providing suggestions for improvement. 

Duties of a Team Member 

Previsit R esponsibilities 
,\ 

1, Study the curriculum outline of the program to' be eyaluated. 

2, Compare the curriculum being taught with actual needs of business and 
industry 

3, Examine the consultative team evaluation forms that will be used as a 
guide during the actual team visit* 

Consultative Team Evaluation Vis.it Responsibilities : 

1. Meet with the institutional representative in charge of evaluation for 
orientation prior to entering the' program area, 

2. Examine the program curriculum and objectives to determine whether 
or not that they are consistent with occupational ne«d$. 

3. Examine teaching materials, supplies, and equipment presently being used 
• in the program. 

4. Make an effort to contact all faculty members and as many students as 
possible. * 

5. Record comments and observations on the consultative team evaluation 
form that has been - provided. ■ 

*i 

6. Meet with the institutional representative for the summary conference to 
discuss the visit, review and assess their findings, and make 
recommendations. 
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Submit individual consultative team evaluation reports (Sample Document 
3) to the institutional representative and clarify "any ambiguous ^ 
statements or responses. 



29 



36 



Sample Document 3 



CONSULTATIVE" TEAM EVALUATION REP0RI 



Program: Date: 

Team Member: " ^ 
Business Affiliation: 

The consultative team evaluation members examine and make recommendations in 
the following areas: . . ' 



1. 


Physical Facilities 


2. 


Instructional Program 


3. 


Equipment 


4 


Supplies 


5. 


Instructional Materials 


6. 


Upgrade Training 



Each. consultative team member should visit the area of the' program being 
evaluated, observe the physical facilities, equipment, supplies, fete, 
interview all instructors and random students, examine program (joals and 
objectives, handouts, fete, and ask for any needed interpretations and 
clarifications. - While in the program area, the team member should record 
responses and observations on the consultative team evaluation report. The 
recommendations may be written then or during the summary conference 
session. 
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/ * Page 2 

1. Physical Xacil ities -*To have effective'instructijon, the physical facilities 
must meet t^e needs of the programs' and students* Please rate the following: 

\ Evaluation Scale: ^ 

\ 3 points Excellent - Needs no improvement 

\2 points Adequate - Needs slight improvement 

/ 1 point Inadequate - Needs definite 'improvement 

O x points Not Applicable- Does- nrff apply 



a, * The size of the c\assroom(s.) 

b. The size of the laboratory area(s) 



c. 
d. 



The lighting in the classroom (s) 

The lighting in the laboratory 
, area(s) A \ 

Gas supply, if needed forV 
instructional operation \ 



f* Water supply, if needed fo^ 
instructional o : p#ration 
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Electrical service availabli 



h. The noise level of the department 



The safety cofidi t ft>ns in the 
classroom(s) 

The safety conditions in the 
laboratory area(.s) • 

Housekeeping--neatness and 
organization 



Proper storage facilities 



m. Walking/working space available 
for free and unobstructed / 
movement in. the area(s) 

Consent: : (PLEASE IDENTIFY CLASSROOM BY GIVING ROOM NUMBER.) 
EXAMPLE: !\<>an 10? ttcrtla jV/v addiiional oJ.cctvioal outlets 



3^points 


2 points 


1 point • 


0 points 


- 




-k. 






c 

\ 








/ 


- 














• 


• 
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• 


* 


1 \ 
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Instructional Program . - 1 • 

a* Are program goals and objectives clearly stated in 
* measurable terms? If no, identify those needing Change, 



b. Are program goals and objectives consistent with current 
occupational-standards? If no, identify those needing 
change. 



c - Are program goals and* objectives in printed form? 
Comments: r > » ._„_.. j : 



d. Are written objectives for individual courses stated^.in 
measurable terms? If no, identify those needing change. 



Are provisions made to eliminate sex or racial^ bias in 
this program? If no,* identify needed changes/ 
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Are student learning experiences -consistent with 
occupational practices and standards? If m\ identify 
those needing change V m ^ N 



J. YES ' 



NO 



Are the occupational techniques being taught consistent 
with occupational practices jand -standards? If no, . 
identify those needing change. 



Are provisions made within the program to work With 
speci.il deeds' such as disadvantaged and handicapped 
students? If no, identify needed modifications/ . 



♦ . r '~ V.' 




3. Equipment 



a. Is the equipment *in this program modern and current 
according to the standards of business and industry? 
If no,* identify that which is out of date. * 



YES_ 



Is sufficient; equipment -available for student use? If no, 
identify; specific 'equipment whet*e addi tiqpal quantities 
are needed for .student use. 



YES^ 
NO 
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Is the equipment in this program in proper operating 
condition? If no, fdSntify that which needs repair.- 

. YES 

' - ' . NO 



Is an adequate preventive, maintenance plan used with the 
equipment in this p,ro§ram. If ru^ suggest ways for 
improvement. o , 

> ; ; ' ^ YES 

NO 



Is all the equipment in this program safe- for' student 
use? If no,, identify unsafe equipmerit. 

' ' ' 4 YES r 

- -NO 



Based on your observation, are students practicing proper 
safety procedures. If no, identify improper safety 
procedures. ' . 

_ * YES_ 

. / ' NO' 



Is eqyipment avail able, sufficient to meet new and emerging 
trends in business and industry? "If no, identify new * 
equipment npeded. 

- « ; ; YES_ 

* * . NO 



Suppl ies 



Are currently needed supplies on hand or readily" 
accessible? If no, identify those needed. 



YES_ 
NO 



D « Are supplies in sufficient quantity to meet student needs?, 
If no, identify supplies wjiere- greater quantity needs to 
be maintained? 



YES_ 
NO 



c ts the quality of supplies consistent with those used in 
the occupational setting? If no, identify supplies where 
the quality is not consistent 'with those used in the 
occupational setting. 

1 J : YES 

" , ; NO 



d.' Are supplies efficiently expended so, as. to minimize waste? 
If no, please give suggestions for improvement. 

. „ / ■ YES 



I ns trufittpna 1 -Ma ter i a 1 s_ 

a * * 

Is tHere sufficient quantity df printed instructional 
• materials (*ucia^as supplemental reading lists, related • 
practice exerci ses handouts', etc.) available?. If no, 
identify thoSe needed. 

YES 



b. Are the printed materials up to. date? If no* 
identify those (that are outdated.. 
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YES_ 
flO 



c. Is there a sufficient quantity of audiovisual 
instructional materials available? ' If no, 
identify those needed. • . 



V 



d. Are the audio-visuals up to date"? If no, identify 
those' that need updating. 



YES_ 
NO 



YES_ 
NO 



e. What is the percentage of use of audio'v.isuaT 
materials in this program area? 



, ft 



f- . f s there sufficient quantity of reference materials 
available for student use? If no,, identi fy those 
that are needed. 



YES_ 
NO 



M6 
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Is sex pr racial bias eliminated in the instructional 
materials used iff this, program?* If no, identify 
specific materials that are slanted toward a parti- 
cular sex or race. 



Upgrade Training 

Are the the, short-term courses which are being offered- 
fn -this program consistent with the needs of persons 
currently working in the field? If no, identify courses 
which should be added or deleted. 
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Sample Document 4 



THANK YOU LETTER 



Dear Mr. Smith: , 

Your contribution to the evaluation of the „ (name of 

program) program at . ■ (name of) 

f** institution t is greatly appreciated.' The giving of your 

time and talent to this 'endeavor will be beneficial to both you and ..this 
institution since it will strengthen the school and, as a result, the 
community. ' 

You will be advised of the plans for progress toward implementation of 
the team recommendations* Only- through constant review can an institution 
continue to grow. Growth was the purpose of this evaluation. You have a 
right to-be proud of yoar part in this. 

Thank 'you for your hejp± 

Cordially, * , , 



Oohn Doe 

Institutional Director 
JE/ije 



\ 
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FOLLOW. UP LETTER 



Dear Mr. Smith: 

* * * 

Much has happened since the visitation for^Whrat-ion of the 

(name of program) program at (name of 

institution on — [date} 

was made. The progress toward implementation of the team s recommendations 
is outlined on the attached form. 

The team was a vi.tal part of this growth picture, and your contribution 
is greatly appreciated. If you would like to discuss the implementation ,of 

the team's recommendations, please telephone us at ; : : 1_« 

We would appreciate hearing from you concerning- this. 

Please feel free to visit the college whenever you have an opportunity. 
Your suggestions are always welcome. We will keep you informed of future 
progress toward the implementation of the team's recommendations. 
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PROGRESS REPORT 

Recommendations: EXAMPLE--The addition of a course on Human Relations 

Response: , EXAMPLE--T4iis course was included in the curriculum 

fall quarter. 1 977, 

Recommendations: EXAMPLE--The addition of a memory typewriter 

Response: EXAMPLE--Funds have not been available. The instructors. 

are working on preparing a proposal requestinn 
that money be allocated. 

Recommendations: 

Respor^e: , 

Recommendations: 
Response: 

Recommendations: > 
Response: , , 

/ 

• (More space available as needed) 



40 , 47 



- Sample Document 6 



CONSULTATIVE TEAM EVALUATION SUMMARY REPORT 



Program: - Date: 

Team Member: . , . «, 

Name } Business Affiliation 



Instructions for jCompleting the Summary Report 

Irt completing the evaluation team summary report, the 
institutional representative will-- / 

1. tally responses in each section: 

2 enter the to£al number of "Yes" and "No" responses in 
the appropriate blanks for all sections after physical 
facilities: 

3; summarize commendations for items that are done well and 
recommendations for the items needing improvement and 
enter in appropriate spaces. 
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Physical Facilities —To have effective instruction, the physical 
facilities must meet the needs of the program and students. Please' rate 
the following: • 

Evaluation -Scale 
3 points Excel lent—Needs no improvement 
2 points Adequate— Needs sVight improvement 
1 point Inadequate— Needs definite improvement 

0 points Not Applicable— Does not apply ■ 

TEAM AVERAGE 
RESRONSE 

a. The size of the classroom(s). " 

b. The size of the laboratory area-(s) " 

c. The lighting in the classroom(s) * 
>.d The lighting in the laboratory area(s) 

e. Gas supply, if needed for instructional operation 

f. Water supply, if needed for instructional 

operation % . ' ■ 



g. Electrical service available 



h. The noise level of the department 



t. Safety Conditions in^the classroom(s) . 
j. Safety conditions dn the laboratory area(s) 
. < k. Housekeeping— neatness and organization 



1. Proper storage facilities* 



m. Walking/working space available for free 
and unobstructed movement in the area (s J 

Summarized Commendations: 



Summarized Recommendations: 



- Page 3 

Enter. total 

2 % Instructional Program nufober of 

a. Are program goals and objectives clearly stated in "Yes" & No 

measurable terms? If no, identify those needing. Kesponses 
change. 

Summarized Commendations: . Y ^S 

NO 



Summarized Recommendations: 



Are program goals and objectives consistent with 
occupational standards? If no, identify those needing 
change. 

Summarized Commendations: • ,- _ 



YES_ 
NO 



Summarized Recommendations: 



c Are program, goal's and objective imprinted form? 

Comments: « _ 1 : * T ",- 

, NO 



Are written objectives for individual courses stated in 
measurable terms? 

Comments : r . ; ^ I YES_ 

' * ' ' NO 



ERiC 



Are provisions -made to eliminate sex or racial bias 
in this program? ' If no, identify needed changes/ 

Summarized Commendations 3 



Summarized Recommendations: 



Are student learning experiences consistent with occupa- 
tional practices and standards?. If no, identify those 
needing change. 

Summarized Commendations: 



Summarized Recommendations : 



Are techniques being taught consistent with those used in 
occupational practices? If no, identify those needing ■ 
change. 

Summarized Commendations: 



Summarized Recommendations 
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Are provisions made within the program to work with 
special needs such as disadvantaged and handicapped 
students? If no, identify needed modifications. 

SCimmarized Commendations: ' : 



YES_ 
NO 



: ^~ 

Summarized Recommendations: 



3.' Equipment 

a. Is the equipment in this program modern and current / 
according to the standards of business and industry? 
If no, identify that'which is .ou,t_of date. 

Summarized Commendations: YE ; 

NO 



Summarized Recommendations: 



Is sufficient equipment available for student use? If 

no, identify specific equipment where additional quantities 

are needed for student use: 

Summarized Commendations: YES„ 

NO 



Summarized Recommendations: 



ERIC 



45 



52 



is the equipment in this program in proper' : - . 

operating. condition? If no, identify that which . 
needs repair. # ■ • 

Summarized Commendations; „_«^ » j YES 

, \ - ' NO 



'Summarized Recommendations: 



Js an adequate preventive maintenance plan used with the 
equipment in this program. If no, suggest ways for im-^ ^ 
provement. . ^ * * 

Summarized Commendations:. - YES 

. . / NO 



Summarized Recommendations: 



Is all the equipment in this program safe for student use. 
If no, identify unsafe .equipment. 

Summarized Commendations: ^ YES 

NO 



Summarized Recommendations 



46 



53 



r 



.Page 7 



Based' on^your observation, are students practicing, 
prpper safety procedures? If ncr,. -identify improper 
safety procedure?. ► — ■ « 

Summarized , Commendations ^_ , YES_ 

NO . 

_ ? \ - 



Summari a^tj^ Recommendations:' 



g. Is equipment available Sufficient to m6et new and emerging 
trends fn business and flnclustry? if no, identify new" 
equipment needed. ' 

Summarized Commendations: , . YES_ 



NO 



Summarized Recommendations 



Suppl ies ; 

a., Are currently needed suppl &S; on hand, or .readi ly ^ 
accessible? If no, identify those needed. ■ ' 

Summarized Commendations: YES_ 

U .'no 



Summarized Recommendation^ : 



Summarized Recommendations: 
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b. Are supplies insufficient quantity to meet student- 
needs? If no/identify supplies where greater 
quantity n^eds toJ>e maintained. 

Summarized Commendations: YES 

' , — - 1 - 

' * ' . HO 



c. Is the quality of supplies consistent with those used 
in the occupational setting? If no, identify, suppl ies* 
where the "quality is not consistent with those used in 
the occupational setting. / 

Summarized Commendations: ' ^_ YES 



Summarized Recommendations : 



Summarized Recommendations: 



NO 



d. ' Are supplies efficiently expended $o as to minimize waste? 
If no, yi ease give suggestions' for'^mprovement , 

Summarised Commendations: : YES 



NO ■ 
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5. Instructional Materials , 

a. is there sufficient quantity of printed instructional 
materials (such as supplemental reading lists, re- 
lated practice exercises, handouts, etc.) available. 
If no, identify those needed. 



Summarized Commendations: 



YES_ 
NO 



Summarized Recommendations: 



b. 



Are the printed materials up to date? If no, identify 
those that are outdated. 

Summarized Commendations: : 



Summarized Recommendations: 




Is there a sufficient quantity of audio-visual 
instructional materi&ls available. If no,, identify" 
those needed. 

Summarized Commendations: 



YES_ 
NO 



YES^ 
NO 



Summarized Recommendations; 
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Are the audio visuals up to date? If no, identify 

those that need updating. ^ 

Summarized Commendations: ' ; Y ^S 

* ! , . . NO 



Summari2ed Recommendations 



What is the percentage of use of audto-visual materials 
in this program area? 



Is there sufficient quantity of reference materials 
available for student, use? If "no, identify those 
that are needed. 

Summarized Commendations; " „ T " 



NO 



Summarized Recommendations: 



Is sex or racial bias eliminated in the instructional 
materials used in this program.? If no, identify 
specific materials that are slanted toward a particular- 
Sex or race. 

Summarized Commendations: 1 , : _ YES 

NO 



Summarized Recommendations : 

. y 
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Upgrade Training 

Are the short-term courses which are being offered in 
this program consistent with the needs of persons cur- 
rently working in the field? If no, identify courses 
which should be added or deleted. 

Summarized Commendations: ( 



Summarized Recommendations 
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•ALTERNATIVE CONSULTATIVE TEAM 
_ PROGRAM EVALUATION INSTRUMENT 



The following evaluative instrument is taken from Olympia Technical 
Community College of Olympia, Washington (Bullpitt, 1980). It is present^ 
here as another alternative to consultative team evaluation of program/ 
implementation. 
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CONSULTATIVE TEAM EVALUATION 
IMPLEMENTATION 

DIRECTIONS FOR RATING: 

EXCELLENT - Nearly ideal, top 5 to 10% 

GOOD - Strong rating, top one-third 

ADEQUATE - Average, the middle third 

BELOW EXPECTATIONS - Fair, bottom one-third 

POOR - Seriously inadequate bottom 5 to 10% 

NOT APPLICABLE - Statement doesn't apply to program 

DONT KNOW— Unable to rate the statement 



Program 
Date 



How would you rate the following: 



GOALS 

A. Goals and Objectives 

1 . Written general program goals are: 

' - Understood and committed to by adminis- 
trators, counselors, and instructors 
- Used as a basis for planning specific objec- 
tives for programs and services. 







t Know 
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- □ 


*□ 
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P 


□ 
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2. 


College planning for programs includes: 


















- Participation by administrators, 


□ 


□ 


□ 


□ 

* 


□ ' 


. □ 






- Participation by instructors, counselors and 


□ 


□ 


a 


p 


□ 


□ 


□ 




.' other support personnel. 
















3. 


The College educational plan is used as a basis for? 


















- Implementing specific programs. 


□ 


□ 


□ 


□ 


□ 


□ 


□ 




- Evaluating specific programs. 


□ 


D 


□ 


□ 


□ 


□ 


□ 


4. 


Written program objectives are: 




□ 














- On file for the program and stated in 


□ 


□ 


□ 


□ 


□ 


□ 




measurable terms. 


















- • Used to evaluate the program.- 


□ 


□ 


□ 


□ 


' □ 


□ 
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5. 


Written performance objectives are: 


















— On file for courses and stated in measurable 
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□ 


□ 


□ 


□ 


□ 




terms: 


















.- Available to students. 


□ 


□ 


□ 
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□ 


□ 




- Used to keep students aware of progress. 


□ 


□ 


D 


□ 


a 


P 
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Labor Market and Community Needs 
















1. 


Data on labor market needs are: 






□ 












- Kept current for the program using a variety- 


' □ 


□ 


□ 


□ 


□ 


□ 




of sources 


















~ Used in planning and evaluating the program. 




□ 


■ □ 


□ 


□ 


□ 


□ 


2. 


Profession/industry standards are: 


















Used as a basis for planning and evaluating 


□ 
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□ 


□ . 




□ 




* the program. 
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- Used as a basis for planning and evaluating 
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course Content and instructional approaches. 
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DIRECTIONS FOR RATING: 

EXCELLENT - Nearly ideal, top 5 to 10% 

GOOD — Strong rating, top one-third 

ADEQUATE - Average, the middle third 

B£LOW EXPECTATIONS - Fair, bottom one-third 

POOR - Seriously inadequate bottom 5 to 10% 

NOT APPLICABLE - Statement doesn't apply to program 

DONT KNOW- Unable to rate the statement 



PAGE TWO 



How would you rate the following: 



=3: — pf^a op C immunity population needs for train- 



"c 



✓ing, retraining and upgrading.job skills are: 

- Kept current for the program. 

- Used in planning and evaluating the program. 
4. Data on job performance requirements and trends 

dre: 

- Kept current for the program. 

- Used to develop and evaluate the program. 

- Used to plan and evaluate course content. 
II. PROCESSES 

A. Instruction 

. 1. Instructional approaches are adapted to: 

- % Recognize occupational objectives of students 
- Meet individual needs of students. 

- Provide learning assistance for students with 
speciat needs. 

- Provide hands on, job related experiences. 
2. Applicable support courses are: 

- - Closely coordinated with the program. 

- Relevant and current to needs of the students. 

B. Articulation is Maintained with: 

4 - Educational institutions offering occupational 

programs (such as high schools, other . 
community and four-year colleges). 

- Community agencies involved with occupa- 
tional education (such asCETA, DVR). 

C. Related Work Experience or Equivalent Clinical 
Experiences Is: * 

- Available at conventient locations to all 
students, day and evening, enrolled in the 
program. 

- Coordinated with classroom instruction. ' 

- Coordinated with employer supervision. 

D. Disadvantaged 7 

1. Special services for disadvantaged students in 
the program are: 

- Readily available. 
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DIRECTIONS FOR RATING: " : . 






• 


PAGE THREE 


• 


EXCELLENT - Nearly ideal, top 5 to 10% 
















GOOD — Strong rating, top one-third f 
















ADEQUATE - Average, the middle third 
















BELOW EXPECTATIONS - Fair.bottpm one^third. 




/ 












POOR - Seriously inadequate bottom 5 to 10% • 














NOT APPLICABLE -.Statement doesn't apply to prpgram 
















DONT KNOW- Unable to rate the statement- 
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. . How would you rate the following:" 
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- Coordinated by qualified staff, 
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- Coordinated witb-pffcgram instruction. 
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2. Special services for handicapped students in the 
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program are: 
















t- Coordinated by qualified staff. 
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- Coordinated with program instruction 
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Planhed^to include modification and adapta* 
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tion of facilities and equipment where 
















needed. 
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3. Special services for the reentry student or dis- 
















placed homemaker are: 
















- Readily available. 
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- Available to assist with the transition/ 
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adjustment to the college scene. 
















- Coordinated by qualified staff. 
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- Coordinated with program instruction. 
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4. Additional services for students with special needs 
















are evaluated through : 
















— ' Monitoring the progress of the students. 


□ . 
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□ ' 


— Assessing program/services accomplishments 


□ 
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□ 
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rn 
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in relation to planned objectives. 
















- Follow up studies to determine employment 


□ 


□ 


□ 


j — I . 
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success of these students. 
















E. Emphasis on Overcoming Sex Bias, Discrimination 
















and Stereotyping is Given to: 
















- Program enrollments, recruitment and 
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admission policies. 
















*- Course and program content and teaching 
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methods. 
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- Selection of curricular materials. 
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□ 
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— Job development and placement. 
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□ 
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— Student counseling and guidance. 
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D 


F. Counseling, Advising / 
















1. Counseling and guidance services are: / 
















— Available and accessible for all students 
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b 


□ 


□ 


□ 
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in "the program-day or night. 
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- Available at satellite and outreach centers. 
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.DIRECTIONS FOR RATtNG: 
EXCELLENT - Nearly ideal, top 5 to 1Q% 
GOOD - Strong rating, top one-third 
ADEQUATE - Average, the middle third 
BELOW EXPECTATIONS - Fair, bottom one-third 
POOR - Seriously inadequate bottom 5 to 10% 
NOT APPLICABLE - Statement doesn't apply t^program 
DONT KNOW- Unable to rate the statement 

How would you rate the following: 

- Keyed to student career and program interests 
and needs. 

— = — I nforming students o f-nontraditional job 

opportunities for both sexes. 
^ - Provided by a qualified, knowledgeable staff. 

- Use a variety of resources that are relevant 
to student needs. 

2. Program includes economic instruction which 
helps the student: 

- Understand employee responsibilities and 
rights. 

- : Evaluate job opportunities in relation to 
salary, benefits and conditions of employ- 
ment. 

- Understand the principles'of business 
operation and cost of doing business. 

3. Program includes consumer education which 
helps students: 

- Manage time and money. 

- Become a wise shopper. 

- Manage the combined responsibilities of a , 
job and a home. 

- Conserve energy and other natural resources, 
r G. Placement Services 

1 . Placement of students: 

~ l s a planned, coordinated service. 

- Identified employment opportunities for 
students in the program. 

- Helps students in the program with market- 
; able skills find employment. 

2. Program completers and leavers desiring employ- 
ment are: 

- Prepared, to apply for a job* 
- - Treated fairly and equally. 

*- Placed within a reasonable ppriod of time in 
a jofcj fqr which trained or closely related. 
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DIRECTIONS FOR RATING: 

EXCELLENT ~ Nearly ideal, topS to 10% 

GOOD - Strong rating, top one-third 

ADEQUATE— Average, the middle third 

BELOW EXPECTATIONS - Fair, bottom one^third 

POOR - Seriously inadequate bottom 5 to 10% 

NOT APPLICABLE - Statement doesn't apply to program 

DONT KNOW- Unable to rate the statement' 

How would you rate the following: 

| 3. .Success and failure of. program completers and 

leavers are: \ 

- Assessed through periodic follow up studies. 

- Madfe available to instructors, counselors 
and advisory committee members. 

- Used to modify , the program and related 
courses. 

- Are current and relevant for the program. 
H. Admissions 

1. Students and potential students desiring enroll- 
ment in the program are: 

- Identified through recruitment activities. 4 

- Counseled on employment opportunities. 

- Treated equitably in enrollment selection. 

- Not impeded by unrealistic prerequisites or 
costs. 

- Able to attend classes at accessible locations 
and convenient times. 

2. Promotion of 'occupational educatioft: 

Informed the public, legislators, news media, 
boards, business community, of program 
goals and needs. 

- Interprets the importance of occupational 
preparation as an option for students^ 
Gains community support and contributions. 

III. RESOURCES 
A. Administralion 

1. The administrative structure provides for direc- 
tion and coordination of the program through: 

- Assignment of qualified administrative 
personnel. 

- Delineation of responsibility, authority and 
accountability. 

Assignment of time fqr supervisors and/or^ 
administrators to provide .for planning and 
evaluation, 

2. Administrators and/or supervisors responsible 
for directing and coordinating are: 

- Skilled in management techniques. 
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DIRECTIONS FOR RATING: 

> EXCELLENT - Nearly ideal, top 5 to 10% 
'GOOD - Strong rating, top one-third 
ADEQUATE - Average, the middle third 
BELOW EXPECTATIONS - Fair, bottom one-'third 
POOR — Seriously inadequate bottom 5 to 10% 

. NOT-APPLICABLE - Statement doesn't apply to program 
DONT KNOW- Unable to rate the statement 

sHaw would you rate the following: - ^ 

~ Committed to and knowledgeable about 
occupational education. 
B>. Instruction 

1. The number of instructors is adequate for 
teachers to: 

- Meet individual student needs. 

- Provide liaison with advisory committees. 

- Assist with student advisement, placement 
and follow up. 

- Maintain ongoing contacts with employers 
and potential employers. 

2. The instructional staff, full and part time, is 
qualified by: 

- Two or more years of relevant employement 
appropriate to the job assignment. 

- Inservice training and/or experience appropri* 
ate to the teaching assignment. 

- Teaching competence as evidenced try peer, 
student and/or administrative judgment. 

3. The college encourages and supports inservice 
opportunities through: 

- Allocating funds for instructor participation. 

- Making time available for instructor partici- 
pation. 

- Assessing inservice growth in teaching 
evaluation. ' » 

4. _ Support staff are utilized in the program to 

provide: 

- Office and clerical assistance. - 

- Classroom help to students. 

- Instructional assistance for teachers. 
C. Equipment and Facilities 

1 . Equipment used on campus or off camput for the 
program is: 

- Representative of that dSeS in jobs for which 
the students are being trained. 

- Safe, functional and wel^Raintained. 

- . In sufficient supply to serve the needs 
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DIRECTIONS FOR RfATING: 

EXCELLENT - Nearly ideal, top 5 to;10% 

(SOOD - Strong rating, top one-third 

ADEQUATE - Average, the middle third 

BE LOW EXPECTATIONS - Fair, bottom one-third 

POOR - Seriously inadequate bottom 5 to 10% 

NOT APPLICABLE - Statement doesn't app'Y to program 

DONT KNOW- Unable to rate the statement 
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How would you rate the following: 



2. Instructional facilities (excluding equipment)' 
used for the program: 

- Are functional for the program. 

- Are flexible and Adaptable to changing 
instructional approaches and special student 

.requirements. 

- Meet safety standards. 

- Are functional for advising students. 

3. Scheduling of facilities and equipment for the 
program : / 

- , Is planned for optimum use. 

- Supports quality instruction. 

4. Instructional materials are: 

- Sufficient in quantity. 

- Current and relevant to the program. 

- Varied. 

Available and accessible to students. 

- Selected to avoid sex bias, stereotyping 
arid discrimination. 

5. Library resources provided to support the pro- 
gram are: 

- Sufficient in quantity. 

- Current, varied and relevant to the program. 
Available and accessible to the students. 

- Selected to avoid sex bias, stereotyping and 
discrimination. 

• D. Advisory Committees 

- Are representative of # the program .for 
which training is provided. 

- Provide input on course content, program 
modification, instructional materials and 

•equipment, student employability and 
placement. 
~ Meet at least annually. 

Extend the program into the community. 
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DIRECTIONS FOR RATING: 

EXCELLENT - Nearly ideal, top 5 to 10% 

GOOD — Strong rating, top one-third 

ADEQUATE - Average, the middle third 

BELOW,£Xf>ECTATIONS- F^ir, bottom one-third 

POOR - Seriously inadequate bottom 5 to 10% 

NOT APPLICABLE Statement doesn't apply to. program 

DONT KNOW- Unable to rate^6«tatemeht 



FttGE EIGHT 



How would you rate the following: 



Budget 

1. The operational budgejt for the program 
4 — Is planned with instructor input. 

- Is adequate for achieving program objec- 
tives. 

- Makes effective 'use of outside funding. 

- Is based on program priorities. 

2. The capital outlay budget for the program: 

- Is planned with instructor input. 

- Supports program objectives adequately. 

- Supports sd^duled equipment replacement 
and repai*r 

- Provides for program facilities refurbishing 
and modification. 
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/ — >J ^Sample Document 8 

Assessment Prof i les'for the Alternative f 
Consultative Team Evaluation Report V* 

/ . ' 
Assessment values for each cri terion -and standard should be consistent with 
definitions provided below. Both quality and quantity of past performance 
should be considered when assessing each standard. Assessment values should 
be considered when assessing each standard. Assessment values should be de- 
termined based upon the conditions of the program at the time of the 
e valuation . 

\ 

■Definitions of assessment values are as follows: 

5 5 Excellent: Indicates that more than adequate time, attention, • 
*" and resources have been assigned for conditions or operations 
~ .to excel, (top 5 to 10%) 

4 = Good: Indicates that some additional time, attention, and re- 
sources are needed to ensure that conditions or operations 
excel. . ( top one-third) 

* * * 

3 = Adequate: Indicates that additional time, attention, and re- 
sources are needed for Conditions or operations define^ by 
the standard to be functioning well. (middle 'third) , o . , - 

Below Expectation: Indicates', a great deal more*time, attention;, 
and resources are needed ^for cortditions or operations de- 
fined by tne,s«ndard to be adequate and, functioning at an 
acceptable level. ( bottom one-third) " . 

1 = Poor: Indicates lhat , the need is critical-for additional time,- 
attention, and resources to be assigned for conditions or 
operations defined 'by the standard to be^ adequate and 
- < function at, an 'acceptable level . (bottom 5 to 10$) 

0 r Not Applicable: Indicates that the standard ,is not applicable 
* given the aims and objectives of the program. 

( 0 ~*Don,' t Knpw: Indicates- that the evaluator cannot make an ade- 
quate judgment of the statement. 

Qualitative values are placed upon evaluative criteria' by assigned numerical^ 
quantities, 0, 1, ? % 3, 1, to each standard and averagi ng .them for each . . * 
criterion measurement . s \ 

Each assessment value' indicates the degree to winch* time , effort, and 
resources have bee^n devoted to-meeting a. criterion. This yalue is confuted 
in the same way for each criterion in each section. - « 

The method of computation can best be explained by the following example^: . 
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HETHQtTA'-- tfhen no checkmarks appear tn %he tt/A or Don't Know columns: 



Criterion: 



^Additional K Support Needed 



V 



* 

r 


N/A 


Don ' t 

Know< 


.Poor 


Below 
tatipns 


Accept- , 

uU 1 c 


Good 


[. Excellent 




0 . 
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2 


3 


4 
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a - 
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b - 


* 






X 
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c - 










• X 






d - 










, x 


















X; 





Multiply the number of checks percolumn by the number at the top of 
the column and total. " * - ' 



Add 
Total 



1 x 1 = 1 : 
1x2 = 2 

2 x-S = 6 5 
,1 x 4'.-=_4 

13. 



Recprd the total in the space provided. 



METHOD 

. * 1 

f 

2. 
3 

4 



. Divide this total by the given denominator and record the quotient in 
the space provided for determining the criterion assessment value: 

' * .. * r ^ 

Divide • - Total 13 = 2.6 (Assessment Value) 

- • 'XT 

Q_ - When check marks appear^in 'the N/A or Don't Know |p*ttfmjs: 
Same as in. METHOD A (Step 1) above. ; 

• *• 

. Count number of check marks in the N/A or Don't Know columns. 

* ' y 

Deduct this number from the given denoirrhjAtor. 

" N Divide the total as computed, in METHOD A above by the corrected 
denominator andsrecord the quotient in the space provided for 
assessment vakies\. , 



Divide Total 

'Corrected Denominator 



(Assessment Value) 
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CHAPTER. SIX 

. ~~ ' ADVISORY COMMITTEE' PERCEPTIONS 

This chapter provides a methodology for the evaluation of occupational 
programs by an advisory committee* ' , 

Goal and Objectives ! 

G6al - • • . * 

'To record advisory committee members perceptions of occupational 
program(s). 

Objectives 

The ojjfrectives of this chapter are to solicit advisory council committee 
members perceptions in order to: 

9 

lr— Gather data for valid program development activities. 

2. Identify needed curriculum improvements. • * - 

3. Identify adequacy and relevance of equipment and facilities in ^ - 
relation to the work world. , 

4. Identify instructional needs.' 

- 5. Compare business and industrial standards with institutional and 
occupational program standards. \* \ 

-to* 

J 

.6. Identify efforts to provide placement assistance to students. 

u 

7. Identify future occupational trendsfT"*^ — 

8. Identify any existence of sex bias* 

9. Identify unmet needs of disadvantaged and handicapped 'students. 

Procedures For Administration 

The institution should designate an institutional representative to be 
in charge of the administration of this component. It is recommended that' 
this individual be a department chairperson and^be able -to devote- 
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appropriae4 amounts of time to the evaluation process. 

Institutional, Representative's Responsibi 1 Hies : 

1. Familiarizes those involved with the survey with the procedures and 
concepts of the process, and works toward a commitment from them. 

2. Develops familiarity with. the various manuals, forms, instruments, 
etc., and acts. as a resource person to those who wilt be using the 
materials/ • <- * 

3. Mails to each member of the advisory committee a packet of materials 
that includes-- • . > 

a', an introductory letter .(Sample Document 1); 

b. ' a stamped self-addressed envelope; 

c. a copy of* the advisory committee program evaluation form.. 
(Sample Document 2), . . 

4. Reviews returned evaluation forms with appropriate faculty, and 
takes the necessary action aciording to institutional policy to 
Implement needed program changes. See assessment profiles for- 
advisory committee evaluation fohn (Sample Document- 3). 

* *-* 

5. Informs advisor^ cbmmittee members of the* results' of the survey and 
indicates tentative, action plan (can be donejjirough the mail or at 
a meeting .of the whole committee). . % . 



Individual Advisory Committee Member Responsibilities 



r-r. : * 

ibei 



1. Records comments and observations on the advisory committee 

Evaluation Form that has been provided. 

• . * < — 

2. Meets with institutional representative to .review the evaluation 
forms. * r 

3. Works with institutional representatives to help implement any 
changes in th% program as Jdentif led. 



Procedures for Dafra Analysis » 
The primary purposes of "this evaluation model is— 

1. individual improvement , . •' , 

2. program, improvement, , *" 
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3. institutional improvement. 

♦ * « 

in order for the data gained from tfoe assessment process in this document to 
be meaningful, it must be used. It is. 'extremely important that all 
individuals be informed of the resuKs and the implications fo.r improvement.. 



* - Listing of Sample Documents v 

•This chapter includes a sample dbtument for_cecordingJ;he perceptions .of 
advisory committee members and information on scoring these responses* — 
This particular instrument has been adapted from Olympia Technical College 
in Olympfa, Washington. 



Docum ent Number 

3 



Document Name 



Introductory C-etter 
* Advisory Committee Evaluation Form 

* m % 

.Assessment Profiles for Advisory, 
Committee Evaluation Form 



Sample Document 1 



INTRODUCTORY LETTER 



. Dear 



We are_1n_,the process of evaluating our occupational program to learn what 
should be done to maiTiTTtrieven more-effective*, „ _ . 

Your views as an advisory committee member are very important to us. It 

would be appreciated if you would take a few minutes to complete the 

Attached form and return%it to. us in the envelope provided; 

i 

•At a. future meeting of your' advisory cemmittee we will tell you about tl% 
results of the evaluation prdcess. 

Thank you for yaur cooperation. . • 

Sincerely, 



John Doe 

Department Chairperson 
db 

Enclosures 
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ADVISORY COMMITTEE EVALUATION FORM 



Program 
Date 



DIRECTIONS FOR RATING: 

EXCELLENT - Nearly ideal, top 5 to 10% 

GOOD - . Strong rating, top one-third 

ADEQUATE - Average, the middle third 

BELOW EXPECTATIONS - Fair, bottom one-third 

POOR - Seriously inadequate bottom 5 to 10% 

NOT APPLICABLE - Statement doesn't apply to program 

DON'T KNOW- Unable to rate the statement < 

How would you rate the following* 



1 Student preparation for seeking employment (such as 
completion of application, presentation of self, interview 
process.* 

2. Student technical preparation for entry-level employ- 
ment (skills and knowledge). 

3. Student preparation concerning work habits, attitude 
;and work quality. 

4. Success of students trained by* the college in your 
field as compared with employees who have not had 
such training.' 

5. College efforts to collect information about on-the- 
job success and failure of former students. k 

6. CoMege response to l^bor force and employment training 
needs for your field from the community. 

7. College provision for training and upgrading currently 
employed personnel in your field. 

8. College response to changing technology and procedures 
in your field. 

9. College response tp emerging employment training 
• • opportunities in your field. 

10. Adequacy and* relevancy of equipment and facilities 
to the un-the-jqb situation. 

11. Availability of related work experience (or clinical 
experience) for students training for employment in 
your field. 

12. Instructor coordination and supervision of work 
experience students. 

13. College response to recommendations for program . 
modification. ¥ 

14. College efforts to overcome sex stereqtyping and 
discrimination in your employment area. 

15. College efforts to provide placement assistance to 
students jn your field. - 

16. College efforts to m%et the needs of disadvantaged 
ana handicapped students. 
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ADVISORY COMMITTEE PERCEPTIONS 



^dvisory Committee Program 

How long haveiyou been a member of 

this committeer ~ 

How often does this committee 
meet? 



Please answer the questions below. , ^ 4 

{Use back of page and extra sheets if necessary.) 

1. In what ways has your advisory committee helped to improve the instructional program in 
your field (such as assisting staff on curriculum development or revision, arranging field trips, 
identifying work experience and employment opportunities)? 



2. What are the principal strengths of the program? 



3. What are the principal needs for improvement in the program? 



Have you participated in college sponsored workshops or other activities designed to alert the 
community to the problems of sex discrimination in the labor force? 
YES NO 



During the past year has your organization hired students from programs of your insitution? 
YES NO 

If yes / how many do you estimate where hired? j 

If no, please indicate why not. ; * 



Does your organization plan to hire any students from the program in the next year? 
YdS NO 



yes, please estimate how many: 
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„ Sample. Document 3 



» ASSESSMENT PROFILES FOR ADVISORY -'COMMITTEE ,* 

EVALUATION FORM . . - ; ' 

* " " ' - # * 

Assessment values for each criterion and standard' should be consistent* 
with definitions provided be'low. -Both quality and quantity of past ; 
perfprmance should be considered/when assessing each standard. Assessment*' 
values, should be determined based upon the conditions of the program at the 
time of the .evaluation . # ' 

Def i nit ions* of, assessment values are as follows: . 
** 

5"- Excellent: Indicate*- that- more than adequate time, attention, and 
resources' have beerr assign^dH'or^xonditTons or-operations-to excel. - 
(top 5 to -10%). 

4 = Good: Indicates that some additional time, attention, and resources 
• <C\ are needed to ensure that conditions* or operations excel . (Top 
one-third) 

3 = Adequate: Indicates* that additional time, attention. and resources 
are needed for* conditions of operations defined by the standard to 
be functioning well, (middle third) 

2 = Below Expectations: Indicates a great deal more time, attention, 
and^ resources are needed for conditions or operations defined by the 
standard to be adequate and functioning at an acceptable level . 0 
(Bottom orfe-third) ' \ 

] = Poor: Indicates that the need is critical for additional time* 

attention^ and resources to be assigned ^for conditions or operations 
defined by the standard to be adequate and* function at an' acceptable 
level, (bottom 5 to 10%) 

0 = Not Applicable: indicates that^the standard is not applicable given 
the aims and objectives of the program.,. 

0 = Don't Know: Indicates, that the avaluator cannot make an adequate 
judgment of the statement. 

Quantitative ^values are placed upon evaluative criteria by assigned 
numerical quantities, 0, 1,2, 3, 4, to eactfstandard agd averaging them for 
each criterion measurement. 



Pagfe 2 



Each assessment value Indicates the degree to which time, effort and 
resources have been devoted to meeting a criterion. This value is computed 
in the same way for each criterion in each section. 

The method of computation can best~be explained by the following examples: 

METHOD A - When no check marks' appear in the N/A or Don't Know columns: 

- * * 

Criterion: Additional Support Needed 



Criterion 





N/A 
0 


Don't 
Know 

0 


Poor 
1 

« 


Below 
Expec- 
tations 
2 


Accept- 
able 

3 


Good 
4 


Excel lent 
5 


- 1 






X 










- 2 








X 








- 3 


i 








X 






- 4 










X 






- 5 












X . 





1. Multiply the number of checks per column by the number at the top 
of the column and total. 

1x1 = 1 
1x2 = 2 
2x3 = 6 
1x4 = 4- 

TT Record the total in the space provided. 

2. Divide this total by the given denominator and record the quotient 
in the space provided for determining the criterion -assessment 
value: . . 

Divide Total 13 = 2.6 (Assessment Value) 



Add 
Total 
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M ETHOD B - When check marks appear in the N/A or. Don't Know columns: 
1 1. Same as in, METHOD A (Step 1) preceding. m ■ * 

2. Count number of check marks in the N/A or Don't. Know columns. 

3. Deduct this number from the given denominator. 

4. Divide the total as computed in METHOD A above by the corrected 
denominator and record the quotient in the space provided for 
assessment values. 

4 Divide Total *= (Assessment Value) 

Corrected Denominator 

Assessment values derived by METHOD A and/or B are then transferred to the. 
assessment value profile chart. 
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CHAP1E.R SEVEN 



ADMINISTRATIVE AND SUPERVISORY PERSONNEL PERCEPTIONS 

This chapter outlines a methodology for assessing administrative and 
supervisory personnel's perceptions of occupational programs and personnel. 
The- purpose of this process is to identify programmatic and personnel 
strengths and weaknesses so that appropriate improvement. activities may be 
initiated. The process is conducted as a needs assessment and should not be 
treated or considered a personnel evaluation. 

Goal and Objectives 

Goal • 

The' goal of this chapter is to record administrative and supervisory 
staff's perceptions of occupational programs and personnel. 



Objectives - 

The obiectlves of this chapter are to solicit administrative and 
supervisory perceptions in helping to do the following: 

1. Provide for staff development activities designed to fulfill 
identi-fied needs, 

2. Identify needed occupational program improvements in areas such ,a_s . 
curriculum, resource inateri al s , physical facilities, and equipment. 

}. Identify expressed needs of the instructors, programs, and the 

department chairpersons, and to provide for effective fulfillment of 
v identified needs. 

\4. Identify any institution-wide needs not previously identified in 
\ other components of the evaluation process. 

U eten n i n i tv± the^ S(^Qpe_of ^Admi n i strat i ve Percept i ons 

Mns chapter provides for identification of the strengths and weaknesses 
of the following: 

v Instructors 

'# Occupational programs 

t Department Chairpersons 




The general evaluation process outlined in this chapter. records the 
department chairpersons perceptions of instructors and of occupational 
prqgrams. In addition the supervisory personnel's perceptions of the 
department chairpersons affe solicited. This evaluation process may and 
should be adjusted to accommodate differing institutional administrative 
structures. 



Assigning Responsibilities to Institutional Personnel , ' 

The fallowing activities are the responsibilities of and should be 
conducted by the following institutional personnel: ' 

1 . Institutional Representative ^. 

a. Encourages understanding, acceptance, and cooperation 4 of all u 
personnel i nvol ved with .the assessment. L 

b. Appoints a faculty-administrative committee to review, adapt, and 
modify instruments- to fit individual needs. Involvement of more „ 
personnel will promote understanding, cooperation, and acceptance. 

c. Maintains master copies of all evaluation forms for administrative 
and supervisory personnel . v 

d. Duplicates sufficient quantities of forms for use with 
administrative personnel. „ 

e. Makes administrative perception fprms available to appropriate ' 
supervisory personnel at a predetermined time.. Refers to the flow 
chart in this chapter (Figure 1) for a suggested, time-table for 
implementation, of this evaluatioa model . J 

2. Department Chairperson - 

a. Approaches instructor needs assessment in a positive manner f 

emphasizes the importance for individual, program, and instructional 
growth; and attempts to establish an atmosphere of mutual trust and 
respect for a meaningful process. . 

J>. Identifies strengths and weaknesses of instructors under his/her 
administration in the areas of teacher effectiveness and ' 
occupational competency (Sample Document 1) : 

\ 

c. Makes appointment with instructors for an individual conference to > 
. , discuss ratings. - 
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d. Record* identified instructor needs on a individual needs analysis 
, profile. . < 

e. Identifies strengths and weaknessesof the occupational programs 
under his/her administration. These needs are identified by a- 
scheduTed*visi t in the program areas and by discussions with 
instructors (Sample Document 2). 

. Vf. Conducts a conference with all program staff to discuss identified 
nee,ds and remediation of them* . , 

3. ' Director of Designate - " 

a. Approaches needs assessment in a positive manner; empKasizes the 
importance of -eval uation for individual, program, and institutional 
growth; and attempts to- establish an atmosphere of mutual trust and 
respect to promote 'understand jng , cooperation, and acceptance, 

* 

b. Identifies strengths and weaknesses in performance of the Department 
Chairperson (Sample Document^) • 

c. Makes appointment for individual conference with the department 
chairperson to discuss identified strengths and weaknesses of 
his/her performance. 

Procedures for Data Analysis 

Ihe*needs iderltjfied through this assessment process are for jjnp^vem^nt 
purposes only and should not be related to tenure, promotion, and contract 
renewal. \ , ^ 

« 

Data Utilization * .'• . • . 

The primary purposes of this material. Js to promote (1) individual 
improvement, (2) program improvement, and (3) institutrortai improvement,. In 
order for the data gained from th'e^ocess in this chapter to he meaningful, 
the data must be utilized. It is extremely important that, all concerned 
parties be informed of the results and the implications for improvement. 
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ADMINISTRATIVE AND SUPERVISORY PERCEPTIONS 
FLOW-CHART ■ 

# 

2 



Determine Scope 
of Administrative 
and 
Supervisory - 
Perceptions 



* Director 

Institutional Rep. 



• Review 

and 
Modify 
Instruments 



FIGURE 2 



Institutional Rep. i 
Department Chairpersons 
'Instructors 



5A 



i 



Summary 
Conference 
Dept. Chairpersons 
• and 
Instructors 



5B 



Summary 
Conference 
, Director 
and 

Dept. Chairperson 



Director 



Implement 
•Appropriate 
Procedures to 
Help Meet 
identified 
Needs 



Director 

Department Chairpersons 



Listing of Sample Documents 



./ 



Document" Number 
; 1 

4 

3 



Document Name . 
c — 

Supervisory Perceptions of 
Instructor 

* 

Supervisory Perceptions of 
Program • 

Supervisory Perceptions of 
Department Chairperson 




Sample Document 1 



SUPERVISORY PERCEPTIONS OF INSTRUCTOR 



Nfernefli Ipstrupt6r 



Date 



The following questionnaire was designed as an inskument to help the Department Chairperson 
identify strengths and weaknesses of the instructor. The* competencies listed are based on nationally 
recognized teacher competencies. 

The comments and ratings made on this form are strictly^ helf) identify needs so that appropriate* 
activities in staff development may be geared to the fulfillment of those needs. 



Rating Scale 

# 

3 - NEEDS VERY LfJTLE IMPROVEMENT 
2 - NEEDS SOME IMPROVEMENT 
1 ~ NEEDS TO IMPROVE 
0 -NOT APPLICABLE 



A. Personal Qualffications - * 

4 1. There should bp # effective interaction between the instruc 
>tor and other professional ^staff. How do you' rate the 

• , instructor's interaction With those listed below? 

a. Other instructors. 

b. , Department Chairperson 

c. Associa^Director for Instruction. 

d. Associate Director fob^tudent Personnel Services 
r e. Director . * \ t * 

f . 'Medfe Specialist • * ** 1 ' * , 

^ g. Coordinator of Special N&*fs 'Program 

• h. Registrar - / ~ ' 

i. Secretarial Staff ■ *\ 

*. }. Pre-Tech Staff. / 

2. An instructor should exert continuous effort towaocf 
'^■ ;v i m prc?ved performance. Ratfe thi$ instructor on the items 
. below. * • „ » 

a. Extent to which mental' effort is applied to perform- 
' ance, . v ■ 
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* 


b. £xtent to which mental effort is applied to perform- 
ance. . 


3 
□ 


2 

□ 


r 

□ 


- 0 
□ 

V 

1 




• * 

c. 'Extent^ to which departmental responsibilities are 
^assumed. 




D 


* □ 


□ 




In order to promote instructional. continuity, instructors 
should be in attendance on a reguJar basis. Hdw would you 
rate this instructor? Extent to wliich his/her attendance 
affects the continuity of instruction. 




• 


"Sfo 

1 




* B., Teaching Skills ,? . 
. 1 There should be effective com'munication-between the € 
instructor^and student, flow would you rate this instruc- ^ 
.* tor m the following areas of communication? . 


□ 


□ 


□ 


□ 




a. He/she makes students aware of their progress. 

' * - H . 












b. He/she explains what is right or wrong abQut assign- 
ments or work. \^ 

c. He/she recognize and adjusts teaching methods to dif- 
* * ferent levels.of student achievement in class. 


□ 
□' 


" a 
□ 


□ 
□ 

• 


□ 
.□ 


< 

2. 

I 


The instructor who applies variety to teaching methobs^ 
uses many techniques to assist learning. Katejnis instruc- m 
tor as to use of the following: * 


• 








1 


a. Guest Speakers 




□ 




□ 




1?. Special class activities * - 1 """N^ ' 


□ 


□ 


□ 


□ 




c. Fieldtrips 




□ 


□ 


■ □ 




d. Audiovisual 


□ 


.a 


□ 


□ 




e. Printed "Handouts 






□ 


□ 


3, 


Studpnt?' knowledge.pf thefr progress is of utmost import- 
ance in a learning situation. How would you rate thfs 
insfructtfr in the following areas? 




• 




» 




a. * hjWher grading procedures are clearly described* 

*b. He/she clearly indicates what material t^sts will cover. 

• * ■„ * •* 


□ 


. □ 


□ 
□ 


□ 
□ 




c Student tc?sts aregraded within a reasonable time. - i * 




□ 

> 








d. H6/she reyiews test results with his/her students. 


□ 


□ 


■ a 


□ 
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4. - Classes shoulabegin and end at a scheduled time and the 

instructor should be present and available to assist 
students. How would you rate this instructor in the follow- 
ing^areas? 

a. His/he'rcTas^es and laboratories begin at the scheduled 
* time.. - 

b. His/her students are dismissed at the scheduled time. 
. • c. He/she i s pre^ mwhen classes are in session. 

d. He/she uses his/her planning time effectively. 

e. He/she uses his/her planning time effectively. , 

5. 'Subject matter must be presented in an organized manner. 

How would you rate this instructor in the following areas? 

a. Subject matter is presented in an order which. help$ 
students understand. 

b~. He/she stays on subject or related material. Does not 
waste class time on unrelated gnaterial. 

0 

- c. His/her assignments are clear and easily'understood. 

d" He/she gives enough time for completion of assign- 
ments. 

e. He/she is well prepared to conduct classes/laboratories 
each day. 
* *■* 

U He/she has a daily lesson plan and uses it. " 

g. He/she reevaluates and/or revises course syllabi when 
appropriate. * ^ 

v X* 

6. The instructor should fcjp fair when working with students. 
How would you rate this instructor in the following areas? 

He/she gi^fes the grades earned. 

b. He/she gives individuals a fair share of his/her time. 



c. He/shfc maRes class assignments-which apply equall 
to all persons. 

d. He/she posts and meets-Affice hours. * 4 



VZ.^ Human relations are of extreme importance to the success, 
of the program. Please rate tipfe following concerning the 
human relations betyveen* m\s instructor and higher 
students. 

a. H^jhe is consideVate 2nd tolefrant of students 
opinions. * 
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• □ 


o 
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Or 
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n 


[."] 
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□ 




□ 


n ■ 


□ 


□ 


a 

• 


□ 


□ 




□ 


□ 


□ 


a 


□ 


□ ■ 


□ 


□ 


□ 




□ 


□ 


□ 


□ 




□ 


n 




u 
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□ 


□ 


□ . 


□ 


□ 


□ 


□ 
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□ 
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-J 


- 
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□ 
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3 


2 


1 


0 


b/ 


He/she gives personal attention to his/her students 
wnen neeaeo. 


' □ 


□ . 


□ 


□ 


c. 


He/she is caurreous toyvard students. 


□ 


□ 


D 


□ 


d. 


He/she displays self-control toward students. 


□ 


6 


• D 




e. 


He/she gives criticism in a courteous and helpful 
manner. 


□ 


□ 


□ 


□ 


f.. 


He/she encourages students to ask questions. 


□ 


□ 


□ 


□ 



g. He/she responds to student questions in a considerate 
and courteous manner. 

Ki. His/her relationship with his/her students, is not influ- 
enced because they are male or female. 

i. His/her relationship with his/her students is not influ- 
enced by his/her particular riceT\^ 

j. His/her relationship with his/her students* is not influ- 
enced because.of students 4 age.- 

8. An-ef ficient instructor processes paper work promptly and 
accurately. How do you ra<e this instructor? He/she sub- 
mits required paper work^and reports that are prompt 

and accurate, 

9. All staff, including instructors, should assist in job place- 1 
ment efforts. How do you rate this instructor? 

a. He/she assists the students in his/her prograrp in 
" finding jobs for which they are trained. 

b. He/she assists the job placement coordinator and other 
staff in the job placement effort. 

10. Instructors should maintain a positive relationship with 
related business and industry- How do you rate this 4 
instructor in this area?' * 

a. He/she has business and/or industrial representatives ^ 
visit his/her program. » 

b. .He/she tffsits business. and/or industries that relate 

to his/her instructional program. , 

1 1. Please inrifcate below any areas in which assistance needs 
to be- provided to this instructor. * • * 



□ □ □ Q 

□ D D □ 



n □ 



n n n □ 



□ a □ □ 

□ □ □ □ 



□ P. □ 
nana 

X 
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Sample Document 2 



SUPERVISORY PERCEPTIONS 
PROGRAM 



Program 

Date 



This program evaluation is based on the standards of the Southern Association 
of Colleges and Schools. The evaluation is to be done by the Department 
Chairperson during a formally scheduled* visit. It is the responsibility of 
the chairperson to verify the evidence available to support the standard and 
render a judgement as to whether or not the standard has been met. 

Q 

Please respond "yesj 1 or "no" to each item. All standards not met are to be 
explained on the last paqe, along with any comments or suggestions for 
improvements. The coordinator ib to provide the department with a cooy of 
the evaluation. » 



PROGRAM 



1. There is a copy, of the school cataloq present in the 
department, available for use by faculty and students, 

* wHich contains the philosophy and purDOse of the institution. 
The goals, objectives, and description of the occupational 
program. 

2. The program clearly reflects the philosoohy andnurDose of the 
institution and the needs of the students. 

-3; Admissions requiremerijs are reasonable in relatjon to expecta- 
tions- of student success. 

4. There is evidence of semi-annual advisory committee meetings. 

5. The department comprehends and participates in a system of 
evaluation which leads to the up-dating and/or improvement of 
the* individual instructor and the occupational program. 

* ' ' - ■ « 

6. The instructional program is organized to provide the knowledge 
and skills development tha.t are essential, for succes^in the / - 
occupation. ' 

7. Within the classrooms, shops, and laboratories, there isr 
evidence j;hat instruction has been properly organized and is 
being implemented trough mjrt t.i-media approaches. 



1 



Teaching methods and procedures make orovisions for individual 
differences and needs. 



9 

ERLC 



8s.: 



Supervisory Perceptions Prooram ' Pane 2 

r 

9. To ensure skill prof iciency , sufficient oractice is orovided 
with appropriate and suitable equipment similar to that 
currently accepted in business and industry. 

10. Joh orientation, work hahit^, and attitudes are interwoven 
i&to the instructional program to assure job compatibility. 

11. Activities which include health emphasis, job- safety, and fire 
prevention are an integral part of instruction. 

* * 

12. Records showing the progress of the individual student are 
maintained and made a part of hi-s/her permanent file. 

.13. There is a system of evaluating student achievements 

14. There is demonstrated a continuous effort to determine the . 
effectiveness, reliability, and validity of the methods of 
evaluation. 

15. Lesson pl.ans have been developed and are utilized. 



STAFF 



16. Tnere is evidence of liaison between each instructor and the 
respective business industry.- 

v 



> 

PHYSICAL FACILI riES, 



17. Existing facilities include adequate soace and utilities in 

classrooms, laboratories, and shop areas which orovide for 
safe and orderly instruction. 

18. There is adequate light, heat,. and ventilation ip all areas of 
the facility with particular attention to conditions which 
might adversel y. affect health and safety. 

# - , 

19. Proper equipment and adequate instructional and non-instructional 
supplies are made available to supoort the instructional programs 

• offered by the institution. * 

20. Equipment snlerted represents the grade and type used by .business 
and industry. 

' 21. The department has a system of supply £hd equipment inventory 
which includes instructional and non-instructional items. 
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Supervisory Perceptions Program 



22. All instructional equipment and suoolies meet aopropriate 
safety standards. . . 



Pcfqe 3 



23. *First aid supplies are readily available.- 

LEARNING RESOURCE CENTER 
24. There is a learning resource center provided by the department. 



_ 25. The learning resource center(s) includes sufficient materials 
to facilitate a multimedia approach to instruction. 

26. The equipment and material are appropriate to the needs of the 
^ programs served. . 

r 

27. Materials include such items as audio-visual aids and 
equipment; reference books; industrial and technical 

^rianuals; and trade, technical, and professional periodicals. 

28. A current inventory is maintained and updated bi -annual ly. 

29/ A plan exists for annually evaluating the effectiveness of 

the learning resource center(s). 

PL ACEMENT AND FOLLOH -UP • • # * 

'30. There is evidence in the department that a follow-up proaram 

is conducted annually; which collects, records, and maintains 
employment information over a fi\re-year period is vn operation. 
(Such as -the annual follow-up report of the placement office.) 

DESCRIBE ANY STANDARDS NOT MET AND ADD ANY COMMENTS OR SUGGESTIONS BELOW: 
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Sample Document 3 



SUPERVISORY PLRCEPTIONS 
Department Chairperson 



Person to be rated 



INDUCTIONS: Please rate the person named above on each of the items 
listed below. Be frank and honest--no one wilr have any way of knowing 
how you personally answered these questions. 



Please read each question 
carefully. Then circle the 
number that matches" We 
response closest to your 
view. Use the rating scale 
to the right. 



0 
1 

2 
3 
4 
5 



NO OPINION OR DON'T KNOW 

NEVER 

SELDOM 

SOMETIMES 

USUALLY 

ALWAYS 



Circle one number for each ite'm. 



1. Demonstrates brdaa Knowledge and . 
* thorough understanding of his/her 
administrative area. 



NO 

OPINION NEV SEL SOM USU ALW 



1 2 3 4 5 



2. Understands the important details. . Q. 
cf his/her staff's work. 

3. Shows interest and enthusiasm in . . 0 
his/h'er work. 

$~ 

4. Expresses his/her thoughts cltfSrly . 0 
and effectively. 

5*. ' Sets clearly defined gtfals and ... 0 
objectives for himseTftfhersel f 
and h4s/her staff". 



2* 3 4 



2 V 3 4 



2 3 4 



2 3 4 



5 
5 
5 
5 



6. Plans carefully and antic f pates, 
possible problems^ 

7. .Follows his/her- own plans and 

exhibits the persistence 
necessary to accomol ish/qodts 
and objectives. - 

8. Is well organized 



1 2 ' 3 4 5 



1 2 ^ 3 4 5 



1 2 3 4 5 
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ADMINISTRATOR EVALUATION QUESTIONNAIRE 



PAGF. 2 



10. 
11. 

\z. 

13. 

14. 
15. 

16. 

17. 

18. 

19. 

20. 
'21. 

22. 
23.' 



Ci rcle one number for each item. 

Effectively manages the efforts . 
of those who work for him/her so 
that his/her organization operates 
at peak efficiency. 

Mafes thoughtful", well reasoned 
decisions. 

Works hard 



NO' 

OPINION NEV SEL SOM USU 



Makes sure that important work 
gets done on time, # 

Adjusts quickly- to changes in 
plans or' procedures. 

Performs well under ]*ressure . . 

Controls his/her emotions even . , 
when things are not going right. 

Effectively evaluates programs, . 
practices, and personnel. 

Is willina to try new approaches *. 
or. methods. 

Clearly defines and explains what 
he/she expects of staff members. 



Hires the most capable people he/. . 
sh^ can get. 

Supports those who tfork for him/her. 

Is' conscious of the problems that . 
exist at your level . 

Encourages staff memebers to raise . 
questions $rui express their 
opinions. * ^ 

Considers viewpoints that differ . . 
from his/her own. 



0 



1 



0 

n 



o 
o 

0 

0 

0 

0 

0 
0 



2 
2 

2 

2 

2 

2 

2 
2 



3 

3 
3 

3; 

3 

3 

3 

3 



4 



4 
4 

4 

4 

4 

■4 



3 ' 4 
3^ 4 



ALW 

5 



5 
5 

5 

5 

5 

5 

5 

5 
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ADMINISTRATOR EVALUATION QUESTIONNAIRE 



PAGE 3 



Circle one number for each item. 



24. Encourages staff members to • . 
. develop innovative solutions to 

problems. 

25. Cr^t&'S a feelina of unity and 
v enthusiasm among those he/she 

has contact with. 

% 26. I r , courteous and considerate 

2 7 . Is firmest and dependable in . . 
his/her dealings with staff 
members. 



NO 

OPINION NEV SEL SOM USU ALW 



?8. 

30. 
31. 



Treats all staff members fairly 
and impartially. 

Compl iments % and thanks staff . 
members appropriately and 1 
sincerely. / 

Recognizes and reward^^aff 
members* . achievements. . 

Supports the College's policies-, 
procedures, and philosoohy. 
* 

rio<>s a good jot) of promoting . 
tne College's public 'image. 



0 

0 

0 

0 

0 
0 



2 3 '4 5 

2 3 4 5 

2 3-4 5 

2 3'4 5 # 

2. 3 4 5 

* 

" 2 3 4 5 

* 

2,3.4 5 

2 3 4" 5 
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CHAPTER EIGHT 



* • • i-NSTRUCTOR PERCEPTIONS 

: 1 ' 

This chapter provides *a methodology to assess .instructor's perceptions 
of the following: 

Self f{ Instructors) 

Program 

Student Personnel and Support Services 
Department Chairperson 

The self-assessment instruments for instructors assist in the — — 
construction in a self-review of their teaching^effectiveness and mastery of 
occupational competencies. Examples of competency ^ istlngs for three 
programs are includedy^as sample documents. 

Procedures for administration and data utilization, instructor 
perception forms, and other sample documents are included. One copy of each 
8f the instructor perception questionnaires could serve as a tally 
instrument and composite report for teacher responses. 



Goal arid Objectives 
/ 



Goal 



To record instructors- perceptions of the program, student personnel and 
support services, department chairperson, and their own individual , x 
performance. 

Objectives 

\ The objectives of this chapter are to solicit instructor perceptions in 
helping to do the following: 

1. Provide for valid staff ydevel opment activities designed to fulfill 
self-identified needs. 1 , 

2. Identify needed occupational program improvements, in areas such as . 
<r^/> . curriculum., resource materials , physical Tacilities, and equipment.^ 
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3. Identify, strengths, anci , weaknesses of student personnel and support 
'Services as- related to individual .instructor and prograrji 'needs . v 

4. Identify strengths and weaknesses of the department chairperson , as 
v ,related to individual instructor^ program, and institutional- needs. 



, , Procedures for Admin i stratmn 

\ : " — ' 

ect Ins 



Select Institutional Representative * 

Prior to the commencement of any evaluation activities, the institution 
should-designate an institutional representative .to be in r charge^of 
administration of- t,hi evaluative component. It is recommended that the 
-institutional representative be an .administrator or supervisor, be familiar 
Witft 'and engaged in the day-to-day operation of the occupational programs 
and services, and be able to devote appropriate amounts of time to .these 
j responsibilities. 0 , ; 

/ " w Identify Components of Instructor Perceptions ^ 

Instructor- perception components are the fol Vowing; 

1. -Self (instructor) . -* \ c 

2. t * Occupational Program . 

3. *^ Student , Personnel and Support "Services - 

y * .r ' ( , - t 

1 ■ 4. Department 'Chairperson v . , • , ' 

Assign gesponsibi 1 i ties of, Institutional Personn el 

1. , institutional Representative r « « 

a. Selects a faculty-admipistrative committee to review and modify 
instruments. \ 

' ^ b. • Maintains master copies of ^assessment forms., 

c. Duplicates sufficient quantities of forms for vse with all 
instructors. 

. d. Distributes all assessment f6rms*to instructors at appropriate 

5 « times. Refer to the Flow Chart in this chapter for imple- 

mentation of this evaluative process.* The "forms should be 
accompanied by a memo (Sample Document 1) explaining ch* ne£d 
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% for' and importance of this*information. The memo should 

designate a deadline return date and the name of the person .-to 
whom the completed forms should be returned. 

Department Chairperson • r 

a. Orients instructors in a positive .manner to this assessment 
■ process in order to gain their acceptance and cooperation. 

b. Receives the instructors completed selT^and program assessment 
forms • - 4 

c. Holds conferences with indiviudal instructors, reviews and 
di scusses sel f-assessment. v 7 

Meets with program instructors^ a group to discuss the 
program evaluation. 

e** Records identified instructor needs o^ Individual Needs * 

Analysis Profiles and program needs on Program Needs Analysis 
. «■ Prof i 1 es. * . «* * 

Instructor ' 



to appropriate persons as .indicated on the memo 
forms at^the tim.e of issuance. 

an individual canferenge with department 



a. Completes assessment forms for self, program, student personrlel 
-and support services, and department chairperson. Return * 
completed forms 

^attached to the 

b. Participates in 
chairperson regarding self- needs. m 

c. Participates in d group conference with department chairperson 
and all staff of the dccupatio/ial program to discuss program 
needs. 

D.irector or Director 1 s Desiefna,te 

.a". '^Receives assessment forms from instructors for* department 
chairperson, student personnel and^support service 

b, . Holds conference with appropriate personnel concerning 

identified needs. ., * . 

c. Records identified needs fl^ppropr iate need? analysis profiles. 
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Explain - Instruments -. ■ , ' . 

1. Se'lf-Assessment • 

Each instructor is asked to r£te himself/herself (Samp-le Document 
j 2). This assessment r form identifies competencies related to 

individual instructor effectiveness ancf occupational^competency. 

Viie instructors should review competencies /Jevelop.ed for their 

respective occupational *fi eld , assess their mastery of these 

-competencies, and make recommendations for Sel f- improvement (Sample 

1 Document 3) < 

•* * 

2. Program Evaluation 

Using data obtained from advi sofy board members and < 
sel frperceived weaknesses and strengths, each instructor evaluates* 
components of the occupational program in wfrichf he/she teaches . 
(Sample Document 4');( ' - 

3. Student Personnel and Support Services - ^ 

The instructors, give their perceptions of the student personnel and 
support • serv ices _tp identify, strengths and weaknesses as related to 
their individual needs and support of the total program (Sample 
• Document 5). Th.is chapter includes sample instructor perception 
questionnaires for Student -Personnel and Support Services that s 
include Adipi s^sions and Counseling, Registrar, Job PI acement and 
Fol }£vy-,up, Media Services', Instructional Materials Center, and 

- Pre-Tfechu Institutions with mother services must develop instruments 
to meet the, needs. of that institution. The sample instruments may 

% 'need to be modified to meet local existing conditions. . * 

4. Department Qhair person 



Instructors give their perceptions of the strengths and weaknesses^ 
of their department chairperson (Sample Document 6)«* These" 
perceptions provide data to the supervisory staff and the 
administration upon which decisions- for needrfulfil Iment and 
improvement "activities can bV. based, fffe instruments ("Sample, 
Documents*, 2, 3, 4, 5, & 6) were destined to meet the needs of one 
institution, pther institutions j»ay need to develop additional 
instruments for assessment of supervisory personnel. 



/ 
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Procedures for Data Analysis 



Tally Instructions 



Instructor perceptions concerning the program, student' personnel, and* 
support services, $nd department chairperson should be tallied for - 
presentation of a "total 1 ' picture to*the appropriate persons. One copy of 
each of the instructor perception questionnaires could serve as a tally 
instrument and composite report for responses. 

*✓ 

Supervisory and student personnel and support services personnel shoulji 
be apprised of aggregate responses. Written* comments should be typed 
verbatim with no identifying remarks. Many tally techniques ^ould be 
utilized in collecting and presenting this information. Hand tallying has 
k served to be <Jfi adequate method. 

Record on Needs Analysis Profiles 

Identified needs are recorded on the appropriate needs apalysit profiles 

by the institutional personnel designated under "Assigning Responsibilities 
' to* Institutional Personnel" in this chapter.- m ( 

* > • 

Oata Util ization • ' « ' 
: • . - V. 

'The primary purposes of those evaluation materials is to provide for (1) 
individual improvement , (2) program improvement, and" (3) institutional 
improvement. In order for the data gained from the process in this document 
to be meaningful, the da k ta must be utilized. 4 It Is .extremely important that 
all concerned parties be. informed of the results and the implications for 
.iaiproAAement r ~ \ * 

v 

Flow Chant—Instructor Perceptions * 

The flow chart on the following page identifies the process of getting 
the instructor perceptions and. analyzing the data. , 
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FLOW CHART ■ INSTRUCTOR PERCEPTIONS V 



1 



] 4 Select 

! Institutional 
i 

! Representative 



Director 



Admini ster { 



the 



/ 



Instruments j 



Jnst-i tufciona-l -Rep . 
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Identify 
Scope 

♦ of. - 

Instructor 
Perceptions 



J 



Institutional Rep. 
Department Chairpersons 
Instructors " r 



Di sseTiinate 
instructor 
self-perceptions ■ 
and program* 
perceptions, to 
appropriate 
% Department 
r Cha-f Fpersons , 
Institutional Rep. 



5B 



Disseminate 
instructor 
„ perception^.' of 
Student Personnel 

, ■ & 
Support Services 
& 

Department 
Chairpersons , 



Institutional Rep. 



Individual 
and 
Group. 
Conferences 



Department 
Chairpersons 



'Faculty > 
Administrative 
Committee 
tp develop 
modify ^ 
or adapt 
, instruments 



•4 Insti tutional Rep ; . 
Department Chairpersons 
Instructors 



7 



Enter - . 

identified ! 

needs «! 

on j 

appropriate .j 

Needs > ; 

Analysis * . ! 

. Rpof-i-i-es- i- 



V Department 
x Chairpersons 
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/ \ LISTING OF SAMPLE DOCUMENTS 

Number' of Documeht Name of Document \ ' 

1 . *m £xample Memo 

-2' Instructor Perceptions Questionnaire 

Self-Assessment 

« 

3 Self- Improvement Activities 

4 - Instructor Perceptions Questionnaire 

Program Evaluation 

5 Instructor Perceptions Questionnaire 
^ Student Personnel and Support Services 

6 Instructor Perceptions Questionnaire 

Department Chairperson 

) / Alternative Instrument for Gathering 

^ Data from Instructors 
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Sample Document 1 



SAMPLE- MEMO 



TO: All. Faculty 

FROM: 

DATE: 

SUBJECT: Instructor Perceptions % 

The following forms are designed to give you an opportunist^ to 
express your needs and perceptions as they relate to yourself and 
the administrative, .supervisory, and support services provided to 
you. .Your ratings and constructive comments will help provide 
better administration, supervision, and support* that will assist 
* you as you seek to do your gob. 

Your name is required only on this cover sheet for return 
identification purposes and on those* forms that relate to you. , It 
■ /is not required that you sign the Other forms. Leave, blank any 
item not appl icable to you. Please turn these forms in to me by 

. . Upon receipt, all forms will be 

separated to ensure confidentiality of your ratings of other 
persons". 



96 



ERLC 



102 



Sample Document 2 



INSTRUCTOR PERCEPTION QUESTIONNAIRE 
SELF- ASSESSMENT 



{ • • Instructor. 
Program _ 



Date 



) ■ 
The following questionnaire is designed as a self-rating instrument to help you evaluate your 
effectiveness as a teacher. The competencies listed were developed by a faculty-administrative 
committee and are based on nationally recognized teacher competencies. 

The comments and ratings you make on this form are strictly to help you identify your needs as 
a teacher, so that appropriate activities in staff development may be focused on those needs None 
of the responses in this document will be used in' your annual personnel evaluation for contract 
renewal. Please give this information your careful consideration. 



Rating Scale 

. 3 - NEEDS VERY LITTLE IMPROVEMENT 
2 - NEEDS SOME IMPROVEMENT 
1 - NEEDS TO IMPROVE 
0- NOT APPLICABLE 



Personal Qualifications 


*-> 

s 








1. There should be effective interaction between the instructor 
and other professional staff. How would you rate your inter- 
action with those listed bejotv? 


1! 

Ifl 

' 3 


e i 

> 

i e 

z.i,*. 
2 


!! 

1 


s 

■ f 
li 

0 


a. Other 'instructors 


□ 


□ 


□ 




b. Your Department Chairperson 


• 

□ 


□ 


□ 


□ 


c. Associate Director for Student Personnel 


□ 


□ 


□ 


□ 


d. Associate Director for Student Personnel 


□ 


□ 


D 


□ 


e. Director * 


. □ 


a 


□ 


□ 


f. Media Specialist ~ * - 


□ 


a 


a 




g. Coordinator of Special Needs Program 




□ 


a 


□ 


0 

h. Registrar 


□ 




□ 


□ 


t. Secretarial Staff • 


P 


a 

* 




□ 


j. Devefopmental Studies 






□ • 


□ 
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2. An instructor should exerfccontinuous effort toward im- \" 
proved performance. Rate yourself on the items below. 

a. Extent to which mental effort is applied to per- » 
formance. 

b. * Extent to which physical effort is applied to 

performance. 

'3. In order to promote instructional continuity, instructors 
should be in attendance on a regular basis. How would 
you rate yourself? 

Extent to which my attendance affects the continuity of 
instruction, 

*a. I make students aware of their progress. , 

b. " (explain what is right or wrong about assignments 

ortvork. / 

c. I assign learning activities to' improve my students 
■ *. performance. 

•* 

B. Teaching Skills 

1. There should be effective communication between the 
instructor and student/ How would you rate yourself 
in the following areas of communication? 

. a. I make students aware of their progress. 

b. I explain what is right or wrong about assignments . 
or work. ' ^ 

c. I assign learning activities. to improve my students 
performance. 

2. 1 The instructor whp applies variety to teaching nlethods 
uses many techniques to assist learning. 



Rate yourself as to the use of: 

a. Guest speakers 9 * 

b. Special class activities. 
C. Field trips 

d. Audiovisuals 

* ' e. Printed handouts 

3. Students' knowledge of their progress is of utmost 

importance in a learning situation. HowT would you rate 
yourself in the following area»? , 

a. My grading procedures are clearly described. 

'98 
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□ 
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□ 



□ 



2 




1 

n 



□ ' n a 



xd n . 'a 
n * d □ 



□ □ ■ d 

□ □ n 



a - □ □ 





o 


P 


□ 


□ 

4 




' o 


□ 


' h 


□ 




. □ 




*□ 


□ 


/ 


a 


□ 


□ 


□ 




□ 




□ 


□ 
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3 


2 




0 


b. 1 clearly indicate what material tests will cover. 


• .□ 


□ 


□ 


□ 


c. Student tests are graded within a reasonable time. 


□ 


□ 


. □ 


□ 


d. 1 review test results with my students. ^ 


* 

□ 


□ 


■ □ 


□ 


4. Classes should begin and end at a scheduled time and ' 
the instructor should be present and available to assist 
students. How would you rate yourself in the follow- 
ing ar£as? 








t 


a. My classes and- laboratories begin at the scheduled 
tirae. ( 

~* * » 


■ □ 


□ 




□ 


b. My students are dismissed at the scheduled time. 


□ 


□ 




□ 


c. 1 am present when' classes are in session. ' 


D- 


• CD 


□ 


□ 


d. 1 am available toXassist students when classes/ 
m (r laboratories are in session. 


□ 


t 


□ 


□ 

/ 


e. 1 u^ my planning time effectively. 


• □ 

• 


□ 


□ 


□ 


5. Subject matter must-be presented in an organized 
manner. How would you rate yourself in the following 
areas? 










a. Subject matter is presented in an order which helps 
students understand. 




□ 


D 


□ 


b.« 1 stay on subject or related .material- and do not waste 
class time on unrelated material** 


- -□ 
t 

< A 


□ 


f * 




c. My assignments are clear and easily understood. ' 






□ 


□ 


d- l give enough time for completion of assignments. 


n 

- , < 


□ 


" □ 


<* 

□ 


e. 1 am well prepared to qonduct classes/laboratories 
each day. \ 


. □ 


b . 




□ 


f. 1 have a daily,lesson plan anduse it. 


D" 


□ 


□ 


□ 


. The instructor shouJd be fair when working with 
- students. How,Vvould you rate yourself in the following 
areas?. 








- 


a. 1 give the grades earned. 




□ 


□ 


P 


b. 1 give individuals a fair share t>f my time. 




: □ 


□ 


□ 


c. 1 make class assignments which apply equaJly to alt 
persons. ' 


D 


□ 

> 


□ 


• D 


Human relations are of extreme importance to the 
success of the program. Please rate the following concern* ' 
ing the human relations between you and ypur students. 






< 




a. 1 am considerate and tolerant of students' opinions. 


□ 




□ 
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b. I give personal attention to my students wfon needed, 

c. I am coifrteous toward students, - . \ 



d. I display self-control toward students. j > 

e. I give criticism in a courteous and helpful manner./ 

f. I encourage students to*ask questions. / 

g. I respond to student questions in*a considerate rand 
courteous manner. / 

h. I feel that my felatiortship with my studefits \h not 
influenced by his/her particular race. » / 

i. I feel thatmy relationship with students is ndt 
influenced because they are male or female. / 

j, I feel that my relationship with my students is not 



influenced because of his/her age. 



8. An efficient instructor processes paper worK promptly 
pnd accurately. How do you rate yourself? A 

*"\ ' 

I subpnit required paper work and reports that are'prompt 
and accurate. / . < 

9. All staff, including instructors, should assist in job place- • 
ment eiforts. How do you rate youfselfr 

a. I assist the students in my progra^n in finding jobs 
for which-they are -trained. •„,/_____•_ , ■ „. 

r 

b, I assist the job placement coordinator and other staff 
in the job'placement effort. / 

10. Instructors should maintain a positive relationship with 
related business and industry.* hfaw do you rate yourself 
in this area? " / v 

a. I have business and/or industrial representatives visit 
myjprogram. / 

b. I visit business and/pr industries that rebate to my 
instructional program. 

/ 

11. What changes could^oe instituted that would help you • 
improve? • , / * 

7 •' • 

./ -A . 

.12. What additional resources could be provided to assist you 
in yoOr work? 
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*C. Occupational Knowledges and Skills 



Identify below those occupational knowledges and skifls that you feel you need to strengthen 
or improve upon. Also, list any new skills or techniques emerging rn your occupational area 
with which you need to become familiar. In identifying these needs, it would be helpful for 
yoi/to review the skill demands of your curripulum, or competency llsttags, such as VTECS, 
or NO BELSJ Business Education), or other *uch lists. Please list in priority order 



1. 



0 



L 



4. 



• 5. 



1S> 
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SELF- IMPROVEMENT ACTIVITIES 



Instructor 
Program 



Year 



Directions! Please list all staff development improvement activities- in 
, which you participated this past year, for example, courses, workshops* 
conferences, local and state staff development activities. This ^formation 
will provide a record^ of what you hav£ done and provide data for planning of 
your future , staff development activities^ * 



o ■ 
ERIC 



Improvement Activity 



"tf 

to* 



v 
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Approximate. Date 
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INSTRUCTOR PERCEPTION QUESTIONNAIRE 
PROGRAM EVALUATION 



Program: 



Instructor 



In the appropriate space below identify any needs by specific-items of your 
instructional program that could be addressed through' acquisition,, modification, 
*or staff development. - , 



V 



I. Curriculum Needs--(tkiit modifications,, additions, deletions) 



II 



Instructional Equipment Needs— (New Occupational or audiovisual 
equipment'-or student or office furniture needed)^* • 



'III. {earning Resource Needs-.- ( Audiovisual s ,' .books, organisational 

systems, etc-.) ^JpF : " ' '■ • 



Instructor Perception Questionnaire Program* Evaluation 



Page 2 



IV. Physical Facility Needs~(Modifications of classroom or 
lat> space) % ' ; 



\ 



V. Instructional Supply 
instruction or other 


-■r . 1 

neejds-- (Major expenditures to'individual ized 
supply needs not covered by regular budget) 


\ 

\ 




• 

* 




VI. Other Program Needs 


t 

Q 

V * 

V t 




i 

/ 

J . 


\ ■ - i f - 


♦ ' » *■ 
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INSTRUCTOR' PERCEPTIONS QUESTIONNAIRE 
STUDENT PERSONNEL AND SUPPORT SERVICES 



* „ Rating Scale ^ 

3 - NEEDS VERY LITTLE IMPROVEMENT 
2 - NEEDS SOME IMPROVEMENT 
1 NEEDS TO IMPROVE 
0- NOT APPLICABLE 



A. Admissions and Counseling \ 
• 1. Is thoroughly familiar&th school policy and procedure. 

2. Applies policies and procedures equally to all personnel 
* and programs. ' * 

r 

3. Is familiar with the curriculum goals and objectives of 
your program. * 

4. Provides accurate information to students and prospective 
students about your program. 

5. Is available on a regular basis to you for counsel and assist- 
ance regarding student problems. 



6. Is effeetive in assisting you with problem situations, 

7. Provides appropriate feedback to you after counseling 
with student V 

8. Utilizes effective interpersonal communication skills. 

B. ■ Registrar ^ 

9. Maintains-a student record system that provides for 
effective work with the students. 

10. Provides an orderly student registration system. 

1 1 . Provides an effective system for receiving and processing 4 
student quarterly grades. ^ ' 

f " . 

12. Provides an effective system or reporting student attendance. 

13. Provides positive assistance to students in need of financial 

aid. > 

14. Utilizes effective interpersonal communication skills. 

C. Job P lacement and Follow-up 

15. Effectively communicates the servides offered through " 
the job placement and fdllow-up office. > 
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□ 
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□ □ 
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□ □ 
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□ 


□ 
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□ 


□ 
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□ 
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/ s • 


3^ 




i 


0 


16. Effectively assists you in the placement and follow-up 
of students. ' 


□ 

i 




LJ 


LJ 


17. Provides feedback tp you about results of placement 
eTTorx. 


o 


□ 


' Q 


a 


18. Utijizes effective interpersonal communication skills. 


D 


n 




. □ 


A * 

D. Med;? Services < ' 1 \ 

i 


\ 

LJ 








19. Provides a full rang£ of<media services to assist the 
instructor, 


Lj 


LJ 


1 1 


20. Is available to 'assist anc * consult vyith you on your media 
needs. w i ^ 


. — i 

U 


i — i 
LJ 


LJ 


J — I 
L 1 


-> 

21. Maintains an adequate inventory of media equipment for 
instructor use. 


□ 


. a 




L! 


22. Provides effective assistance when requested. 




n 


□• 


LJ 


23. Provides adequate space and equipment for instructors to 
produce-media materials. 


□ 


□ 


LI 




24. Utilizes effective interpersonal communication skills. 


□ 




n 


n 


E. Instructional Materials Cehter. 










/ 

25. TypesN^p reduces, and coNates teacher tests and other 
instructional materials efficiently. 


□ 


n- 


n- 


a 


26. Schedules work and produces within requested time limit. 




LJ 


l — l 
L J 


r — | . 


J- 

27. Produces work of good quality. 


* i — i 
LJ 


i — i 
LJ 


LJ 


" 1 — \ 


28. Assists instructors in reproducing materials. 


i — i 
LJ 


i — i 
LJ 


i — t 
LJ 


n 

LJ v 


29. Utilizes effective interpersonal communication skills. 


a 


a 




a 


F. Developmental Studies..- 










30. Has effectively communicated the services available to 
you arid to students. 




i — i 
1 1 ■ 

t 


i — 1 


i — i 


31. Students who have completed developmental studies 
generally have the same basic skills as other students* 


a 


□ 


□ 


a 


32. Readily accepts your referrals of students for special help. 


□ 


D 


i 

if 


ri 


• 

33. Provides meaningful helplo students whG are referred. 


□ 


D 


n 


a 


** — 34^Pfovides assistance to help you work with disadvantaged 
or handicapped students in your program. 


- d" 


• n 

/ 

□ 




D 


. 3.5. Utilizes effective interpersonal communication skills. 




■ □ 

* 


'□ 


*3fi Plpacp makp anv constructive comments that would 

%j\J . i I Cu)C 1 1 1 u f\ C Oily W I Ijll UwllVD vui 1 1 1 1 1 vi i u niui v vj t v* 

improve these services to better meet your needs apd the 
needs of the-«tudents. 
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Sample Document 6 



Name of Coordinator 



Rating Scale 

3 - NEEDS VERY LITTLE IMPROVEMENT 

4 - NEEDS SOME IMPROVEMENT 
5- NEEDS TO IMPROVE 



Udic 






m C 

M 

h 
It 






The Department Chairperson 

A. Generic and Support Considerations 


jt i 

* i c 


!* 

It 


Jt 

t 
it 


i . 


1 _ thArAiinhlw familiar lAyith crhftft 1 nftlirtPC anri nrnrprii lf*P<* 

is inorougniy TarniMar wiin ounuui jjunuico anu jjiuucuuico. 




* * 


□ 

4 


□ 


2.* 


Applies school policy and procedures. edually to all* 


t j 




• □ 


□ 


3. 


Provides the teacher with assistance in acquiring necessary T 
materials, supplies, anu equiprncru. 


i — i 


L— J 


□ 


a " 
□ 


4. 


is available on a regular-basis to assist instructors. 


□ 


□ 


"□ 


5. 


Demonstrates an abtlity to work through problem situations. 


i — i 


1 1 


CD — ^ — E^3 


6. 


Provides leadership by example. 


i — i 


i — j 




□ 


7. 


is dedicated to making your instructional program as efficient 
as possible. / 


□ 


□ 


□ 


□ 


8. 


Demonstrates interpersonal skills that result in productivity by: 












a. Seeking^fefedback and information. m ^ 




•D*. 


□ 


□ 




b. Diagnosing individual and group problems. 


□ 


□ 




a 




c. ResolvTng conflicts. 


□ 


□ 


□ 


■ ' p. 




'd. Utilizes effective interpersonal communication skills* 


□ 


a 


□ 


' □ 

Y 




~e. Controls his/her emotions when.things are not going well. 


□ 




□ 


□ 




f . Encourages .questions and considers viewpoints that differ 
from his/her own. 


□ 

s 


? 


□ 


■a 


9. 


Demonstrates decision making skills by: 










«k s a. Seeking related information from a variety of sources. 

A 






□ 

* 


a 
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• 3 


• 2 


1 


0 




b. Consulting with those whom the decision affects. 


□ 


□ 




rJ : 




m c. Identifying alternative strategies and consequences. 


□ 


D 


□ 


D 




d. Selecting and implementing a strategy^--- 


□ 


□ 


~3 


□ 


- * 


10. Observes program operation and individual instructors on a 

roniilar. Hacic co ac to Hp in no<itinn to of fpr annronriatP 
it^Uldi Ud«>l«> 3>vJ db IJJ Uc III JJvalLIUII LU Ullci a\J\J\\J\J\ Idle „ 

assistance. 


* □ 


a.* 


□ 


□ 




f^iirrinilum anH Instruction 












1 1. Is familiar with the objectives and curriculum of your 

nronram • 
)ji uyi di 1 1. „ 


□ 


□ 


n 


□ 




i V/Ui iLiiiuuuoiy ciiipi idbizco uur i ii>utuin ucVciupinciH diiu 
instructional improvement. 


! — I 


I — | 


I — I 


i — i 


*> 


13. Assists instructional personnel in: * 






* 


* 




a. Writing goals and objectives. * 


a 


□ 




□ 




b. Selecting content. 


□ 




□ 


□ 




c. Selecting strategies. 


□ 


□ 


□ 


□ 




H Splprtinn stuHpnt px/aluatinn mpthnH*; ann nrorpHurps 

U. wGIGOLIIly 31UUCIII CVQIUQIIUI 1 IMClllUUw Ql IU piUV<CUUICrf« 


n 


□ 

lm — 1 


□ 


□ 




14. Assists instructional personnel in developing strategies 

anH skills in classroom manaofimpnt 

QIIU OrNlllJ III V/ladvi UUI 1 1 1 1 1 Ql 1 Oyv 1 1 Id 1 L. ^ t 


□ 


a 


□ 


□ 




1R Prnx/iHPc IpaHprshin anH assistance in thp imnrox/pmfint 
1 j, • ivvviLJvd led uci oi 1 1 u aim aswOLai iuc hi liig iiiipiuvcinviii 

of teaching techniques employed by individual instructors. 


n 


i i 


| — l 


n 




Professional Growth , 












16. Works with the instructors to develop appropriate staff 
development plans that are designed to meet thfe 

\ iHpntif ipH nppH<; ^ 


: ' D 

*• 


□ 


□ 


□ 




17. Participates in formal evaluations that identify the needs 

' Y\f f nrl i\/iH i 12 1 i n^ctn if*torc anH thpir o ron r a m c 
Ul IllUIVIUudl If loll UL.LUI o dl IU Lllcll yHJyldlllO. 


. □ 


D 


□ 


□ • 




* 

1fl MaffPc inHiv/iHi ia!s awarp nf thp rpsultSkOf pval nation anH 

I O. IVIQNCd II IU IV lUUdld QiVdl C \Jl LIIC lygUUO^UI VVOIUWUUI 1 CJI Ivl 

needs assessments conducted. 


i i 


• 1 1 


n 


HI 


• 


19. Seeks and- utilizes suggestions from staff for improvement. 


d 


□ 


□ • 


□ 




20. Please indicate befTow any, constructive suggestions that will 
, assist your department chairperson to improve his/her 
assistance to you. 


□ 


D 




□ 


* 


f • 
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ALTERNATIVE INSTRUMENT 



The following instrument is taken from Olympia Technical Community 
College in Olympia, Washington, (Bullpitt, 1980) and provides an alternative 
methodology for gathering data from instructors. 
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FACULTY APPRAISAL OF 
PROGRAM 

DIRECTIONS FOR RATING: 

EXCELLENT - Nearly ideal, top 5 to 10% 

GOOD - Strong rating, top one-third 

ADEQUATE - Average, the middMhird 

BELOW EXPECTATIONS - Fair, bottom one-third. 

POOR - Seriously inadequate bottom 5 to 10% 

NOT APPLICABLE - Statement doesn't apply to'program 

DONT KNOW— Unable to rate the statement 



Sample Document 7 



Program 
Date 



t4 



sis 



How would you rate the following: 

I. GOALS 

A. Goals and Objectives 

1. Written general program goals are: 

- Understood and committed to by adminis- 
trators, counselors and instructors. 

2. College planning for programs includes: 

- Participation by administrators. 

- Participation by instructors, counselors and 
other support personnel, 

3. The College educational plan is usfed as a 
for: 

I mplementing specific programs. 

- Evaluating specific programs. 

4. Written program objectives are: 

- On file for the program and statedMn 
. 4 measurable terms. 

- • Used to evaluate the program. 

5. Written performance objectives are: 

- On file for courses and stated in measurable 
* terms. , x 

- Available io students. ^ 

- Used to keep students aware of progress. 

B. Labor Market and Community Needs 
1. Data oiflabor market needs are: 

- Kept current for the program using a variety 
of sources. 

- Used in planning and evaluating the program. 
•2. Profession/industry standards are: 

- Used as a basis for planning and evaluating the 
program. 

- Used as a basis for planning and evaluating 
course content and instructional approaches. 

3:/* Data on community population needs for train- 
ing, retraining and upgrading job skills are . ) 

- Kept current for the pirogram. _y' 

- Used in planning and evakjating the program. 
- Used in-scheduling and locating the program. 

4. Data on job performance 'requirements and 
trends are: 

- Kept current for the program. 

- Used to develop and evaluate the' program. 

- ' Used to plan and evaluate course content. 
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DIRECTIONS FOR RATING: 

EXCELLENT - Nearly ideal, top 5 to 10% 

GOOD ~ Strong rating, top one-third 

ADEQUATE r Average, the middle third 

BELOW EXPECTATIONS - Fair, bottom one-third 

POOR — Seriously inadequate bottom 5 to 10% 

NOT APPLICABLE - Statement doesn't apply to program 

DONT KNOW- Unable t6 rate the statement 
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How would you rate the following: * 




Know 
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1K PROCESSES 
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A. Instruction % 


* 














1. Instructional approaches are adapted to: 










□ 






-~ Recognize occupatipnal objectives of 


r — i 
□ 


□ 


□ 


□ 


students* 












1 — 1 
1 1 


- Meet individual needs of students. "N 


1 — ) 


□ 


1 1 


i — i 


1 — 1 


1 — 1 


- Provide learning assistance for students 


1 — | 
LJ 


i — S 


1 1 

1 1 


i — i 


1 — 1 


1 — 1 


1 — 1 

1 1 


with special needs. • 












1 — 1 
1 1 


1 — 1 
1 1 


- Provide hands on, job related experiences. 


i — i 
LJ 


□ 


1 1 

1 1 


i — i 


1 — 1 
1 1 


1 2. Applicable support courses are: * . 








' □ 


□ 


□ 


□ 


- Closely coordinated with the program. 


□ 


r — i 
□ 


□ 


- Relevant and current to needs of the student. 


□ 


— — 

□ 


1 | 

□ 


□ 


1 — 1 

□ 


1 — 1 

LJ 


1 — 1 

. LJ 


B. Articulation is Maintained with: 






1 1 






1 — 1 

1 1 


n 
i i 


— Educational institutions'offering occupational 


■ * i — i 


.□ 


1 1 


1 — 1 
1 1 


programs (such as high schools, other com- 
















munity and four-year colleges). « * 










□ 


□ 


□ 


- Community agencies involved* with occupa- 


□ 


* □ 


f — \ 


i — i 
□ 


tional education*(such as CETA, DVR). 
















C. * Related Work Experience or^Equiv^lent Clinical 
















Experience Is: 










r — \ 




1 — 1 


- Available at convenient locations to all 


. □ 


' □ 


□ 


□ - 


□ 


students, day aQ$ evening, enrolled in the 
















* K /" program. ' \ * 
- Coordinated with classroom instruction. 


□ 


□ 


□ 


□ 


□ 




□ 


*--- Coordinated with employer supervision. 


□ 


□ 


f — \ 
□ 


i i 

□ 


1 i 

□ 




1 — 1 
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D. Disadvantaged s 
















1. Special services for disadvantaged students in 






• 










the program are: 

Coordinatead by qualified staff. . . 












□ 


P. 


ZD 


□ 


a 


□ 


□ 


— Coordinated with program instruction. 


□ 


□ 


□ 


□ 


□ 


a 


□ 


2. Special services for handicapped students in the 
















program are: 












□ 


□ 


— RpaHilv available - 




□ 


□ 


□ 


Coordinated by^qual if ied staff. 






\ 










Coordinated with program instruction. > 


□ 


□ 


□ 


□ 


□ 


□ 


□ 


- . Planned to irfclude modification and 


□ 


□ 


□ 


□ 


□ . 


□ 


□ 


adaptation of facilities and equipment where 
















needed. . . 
















3.* Special services for the reentry student or dis- 
















placed homemaker are:' 










/ 






' ~ Readily available. l t \ 


□ 


D. 


□ • 




□ 


□ 


□ 


- Avaifable to assist with the transitionA 


.□ 


□ 


□ 


□ 


□ 


□ 


□ 


adjustment to the c6lle,ge scene, \ 
















Coordinated by qualified staff. 


□ . 


□ 


□ 


□ 


□ 




□ > 


Coordinated with program instruction. 


□ 


a 


□ 


□ " 


□ 


□ 


□ 
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DIRECTIONS, FOR RATING: ^ ■ w PAGE THREE 

EXCELLENT ~ Nearly ideal, top 5 to 10% 
GOOD - Strong rating, top one-third '* 
ADEQUATE - Average, themiddfe third * i 
BELOW EXPECTATIONS ~ Fair, bottom one-third * . 

POOR - Seriously inadequate bottom 5 to 10% t . 

NOT APPLICABLE - Statement doesn't appjy to program 
DONT KNOW- Unable to rate the statement 

How would you rate the following: 

4. Additional services for students* with special heeds 
are evaluated through : # , 

- Monitoring the progress of the students" 
-r Assessing program/services accomplishments 

jn relation to planned objectives. . 

- Follow up studies to determine employment 
success of these students. 

£. Emphasis on Overcoming Sex Bias, Discrimination and t 
Stereotyping is Given to: 

- Program enrollments, recruitment and admis- 
sion policies. 

— Course, and program content and teaching / 
methods. / 

- Selection of curricular materials. 

- Job development and placement. 
' - Student counseling and guidance. 

— Staff recruitment, selection and promotion. 
F. Counseling, Advising 

1. Counseling and guidance services are: 

— Available and accessible for all students in the 
program-day or night. 

— Keyed to student career and program interests 
ar)d needs. 

- Informing students of nontraditional job oppor- 
% tunities for both sexes. 

— Provided by a qualified, knowledgeable staff. 

— Use a variety of resources that are relevant K> 
student needs. . y 

2. Program includes economic instruction which helps 
the student: 

% — Understand employee responsibilities and rights. 

- Evaluate job opportunities in relation to sala/y, 
benefits and conditions of employment. ' 

" - Understand the principles of business opera-^ 
' . tion and cost of doing business. 

3. Program includes consumer education which hejps 
students: , { 

— Manage time and money." ' V 

— Become a wise shopper. 
^ Conduct personal business transactions. 

— , Manage the combined responsibilities of a job 

and a home. 

- Conserve energy and other natural resources. 

* 14 2 
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'□ . : 



-Q1RECTI0NS FOR RATING; ^ 
EXCELLENT -.Nearly ideal, top 5 to 10% 
GOOD — Strong rating, top one-third 
ADEQUATE - Average, the middle third 
BELOW EXPECTATIONS - Fair, bottom one-third . . 
POOR - Seriously inadequate bottom 5 to 10% 
NOT APPLICABLE - Statement doesn't apply t6 program 
DONT KNOW- Unable to rate the statement 



PAGE FOUR. 



How would you rate the^ following: 



G. Placement Sen/ices 

1 . Placement of students: 

- Is a planned, coordinated service. 

- Identifies employment opportunities for 
studen ts i n t he p rogram . • 

- Helps students in the program with'Viarket- 
able skills find employment. 

2. Program completers and leavers desiring em 
^employment are: 

- Prepared to apply for a job. 

- Treated fairly and equally. 

- Placed within, a reasonable period of time .in 
a Job for which trained or closely related. 

3. Success and failure of program completers' 1 and 
leavers are: 

1 — Assessed through periodic follow up studies. 

- Made avajlable tb instructors,* counselors 
and advisory committee members. 

- Used to modify the program and related 
courses, 

- ^ Are current and relevant for the program. 

H. Admissions \ * 
1. Students and potential students desiring enroll- 
ment in the program are: 



c 

I* 



1 a. 2 ™ ul 
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• TO 

3< 



o 



III. 
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□ 
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□ . 
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□ . 




* 
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□ 
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□ 


□ 


□ 


□ 


□ 1 


□ 



— • ' Identified through recruitment activities. 




□ 


□ 


□ 


□ 




□ 
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- Counseled on employment opportunities. 




□ 




G 


□ 




□ 


□ 


- Treated equitably in enrollment selection. 




□ 


D 




□ 


.□ 




D 


- not impeded by unrealistic prerequisites or - 




D- 


□ 


□ 


□ 


□ 


□ 


□ 


costs. 


















Able to attend classes at accessible locations 




(3 


D 


□ 


□ 




□ 


□ 


and conventient times. 


















2. Promotion of occupational education: 


















. -' 'Informed the public, legislators, news media, • 




□ 


□ 


□ 


□ 


□ 


□ 




boards, and business community of program 


















goals and needs. . , 


















Interprets the importance of occupational 




D 


□ 


□ 


□ 




□ 


' □ 


preparation as an option for students. 


















Gains community support and contributions. 




□ . 


□ 


□ 


□ 


□ - 


a 




RESOURCES 








A. Administration 


















1. The administrative structure provides for direc- 


















tion and coordination of the program through: 


















Assignment of qualified administrative 
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□ 


□ 
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DIRECTIONS FOR RATING^ *~ 

EXCELLENT -Nearly ideal, top 5 to 10% v . 

GOOD- Strong rating, top one-third * ^ 

ADEQUATE - Average, the middle third 

BELOW EXPECTATIONS - Fair, bottom one-third 

POOR — Seriously inadequate bottom 5 to 10% 

NOT APPLICABLE-- Statement doesn't £pply to program 

DONT KNOW- Unable to rate the statement 

How would you rate the following: 

- Delineation of responsibility, authority and 
accountability. 

Assignment of time for supervisors and/or 
administrators to provide for planning and 
evaluation. 

2. Administrators and/or supervisors responsible 
for directing and coordinating are: 

- Sk'illed in management techniques. - ; 
~ Committed to and knowledgeable about 

occupational education. 
B. Instruction 

'1 , The number of instructors' is adequate for 
teachers to: 

- Meet individual student peeds. 

- Provide liaison with advisory committees. 
Assist with student achievement, placement 

^Sfrnd follow up. % 
' *^Maintain ongoing contacts with employers 
~ and potential employers. 

2. The instructional staff, full and part time, is 
qualified by: 

- Two or more years of relevant employment 
\ . appropriate to the job assignment. 
\\ - Inservice training and/or experience appro- 
priate to the teaching assignment. 

- Teaching copetence as evidenced by peer, 
*j student and/or administrative judgment. 

3. The college ehcoupatjes-and supports inservice 
opportunities through: 

- Allocating funds fdr instructor participation. 

- Making time-wailable for instructor partici- 
pation. ■ 

- Assessing inservice growth in teachirig evalu- 
ation. 

4. Support staff are utilized in the program to 
provide. 

- Office and clerical assistance/ 

- Classroom help to students 

- Instructional assistance for teachers. 
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DIRECTIONS FOR RATING: 

^XCE LLENT - Jttear1y/ideal, v |0p to 10% 

GOOD - Strong rating, top one-third 

ADEQUATE - Average, tH? middle third 

BELOW EXPECTATIONS- Fair, bottom one-third 

POOR - Seriously inadequate ^dttosn 5 to 10% - . 

NOT APPLICABLE - Statement ddesn't apply to prografh 

DONT KNOW- Unable to.rate the statement 

How would you rate the following:- 



C. Equipment and Facilities -\ 

1. Equipment used on fcampus or off campus for 
the program's: < 

- Representative of that used in jobs for which 
th"B students are beinq trained/ 

, Safe, functional andwell maintained. 

- In sufficient supply'to serve the needs 6f the, 
studennts in the'program. 

2. Instructional facilities (excluding equipment) 
used for the'program: 

- Are functional for the program. . 

- Meet the ntffeds of the students. 

Are flexible^and adaptable to changing 
instructional approaches and special student 
requirements. , 
Meet safety standards. 

- Are functional for'advising students, 

3. Scheduling of facilities and equipment for the 
program: 

- Is planned for optimum use. ' 
, - Supports t quality instruction. 

4. ^Instructional materials are: ^ 

- Sufficient in quantity. ^ • 

- Current and relevant, to the program. 0 * 
Varied. ' 
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D. 



- Available and accessible to students. 
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a- 


Selected to avoid sex bias, stereotyping and 
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r'D 






discrimination. m 










<*■ 


Library resources provided to support the pro- 












gram are: 




a 








— Sufficient in quantity. 
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Current, varied and relevant to the program. 


□ 
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□ 
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□ 


Available and accessible to the students. 
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□ 


Selected to avoid sex bias,' stereotyping and 


□ 
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discrimination. - 












Advisory Committees 












- Are representative of the program for which 






□ 


■a 
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training is provided. 












Provide input on course content, program 


□ 


□ 


□ 






modification, instructional materials and 












equipment, student ompfoyability and 












placement. ' 












Meet at least annually. 
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Extend the program into the community. 
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^ frlRECTIONSftORfl^flNG: 
' EXCELLENT/- Nearly ideaUop Sao 10% 
•g G60D gr S]^ong rating, top onepd 
ADEQUATE - Av£rage ; tfte midcfe third 
BELOW EXPECT/^JON$- Fair/bottom one-third 
POOR - SeriouslyfWadequate I^Dttom 5 to 10% 
f % NQT^\PPLICABL£ - Statement doesn't apply to program 
% DulvT KNOW- Unable to rate the statement 
' V < ~ & 
How would y^t^fete thefolirwing^ - . |L 

f& - - ♦ 

'E. "Budgif y 

1. Tps Operational budget for the progi^m v \. m 

- Is F^ned wi||kinstructor input ^ ' 

- Is adlquate jfo^achieving progrsfib obup 
tives. % 

- Makes effective use of outside funding. 

- Is based on program priorities. 
The capital- oi/ttay budget for the program- 

- Is planned With instructor irf^t. 

- Supports program obi^ctives^i^uately. 

- Supports* program objectives.adequatefy. 

- Supports scheduled equipment replacement 
. and repair. 

- Provides for program facilities. 
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* ASSESSMENT PROFILES 

Assessment values foif each criterion and standard sTiouTcTBe consistent 
"*with defoitions provided below* Both quality and quantity of past^ 
performance should be considered when assessing each standard* Assessment 
values should b.e determined based upon the^conditians of the program at the 
time of .the evaluation : Definitions of assessment values 'are as follows: 

• * b = Excellent: . Indicates that more than* adequate time, attention, and 

resources have been assigned for conditions or operations to excel. 
(Jop 5 to 11%) ■ - 
«* " * 

4 = Good: Indicates that some additional time/ attention and resources 
are needed to ensure thdt conditions or operations excel, (top 
one-third) * 

'w = Adequate: Indicates that additional time, attention and resources * 
^ are needed for conditions or operations defined by the standard to 
be functioning well., (middle third) 

4 = Below Expectations: indicates a great deal more time, attention, 

and resources are needed for conditions or Operations defined by the 
standard to be adequate and functioning at an acceptable level, 
(bottom one-third)- , / 

5 = Poor: Indicates that the need js critical for additional time, 

attention , and resources to be' assigned for coRdi.tiflns err operations 
defined by the standard to be adequate and function at an acceptable 

• level . (bottom 5 to 10%) 

> * t • , •* 

0 = Not Applicable: Indicates that the standard is fiot applicable given 
the aim's and objectives of the program. ^ 

0 =■ Don't Know:, Indicates that the evaluato* cannot -make an adequate 
judgment of the statement. * 

* ■ • 
Quantitative values are placed upon evaluative criteria by assigned •» 

numerical quantities, 0, 1,"2, 3, % t tq each standard and averaging them for 

each criterion measurement* > t 

Each assessment value indicates the degree to which time, effort, and 
resources have bei^n devoted to meeting a criterion. This* value is computed 
irt. the same way for each criterion irr each section. * 

/ The method of computation can best be explained by the following 
examples": x 
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- METHOD. A - When no checkmarks appear in the N/A or Don't Know columns; 
Criterion: Additional Support Needed/' 



Criterion a 



b - 

c > 
d - 
e - 









~8eTow Accept^ 


~Good 


~£xCSTTent 




Know 




Expec- 


able 












tations 








0 


0 ^ 
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5 
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"TIT 

X 


























X' 


! 












X 


1 














* X 





1, Multiply -the. number of checks per column by the number at the top of the column 
and total . •„ 

1x1 = 1- 
Add * • 1 x -2 = 2 

2x3=6 

- ■ 1 x 4 =_4 ' 

Total 13 . Record the tota.l in the space provided. • • 

2. Divide this total by the given denominator and record the quotient in the 
space provided for determining the criterion assessment value: 



Divide . 



Total 13 =2.6 (Assessment Value) 



METHOD B - When check marks appear in the N/A or Don't Know columns: 

— — !> ■ 

1. Same as in METHOD A (Step' 1) above. 

2. Count number of checkmarks in the N/A. or Don't Know columns. 

3. Deduct this number from the given denominator. 

4. Diyide the total t as computed in METHOD A above by the corrected denominator 
t and record the quotient in the space provi-ded for assessment values. 

; . -Divide Total . ' (Assessment Value) 

'Corrected Denominator ' 
Assessment values derived by METHOD A and/or B are then transferred to the assessment 
Rvalue profile chart. - 



118 



9 

ERIC 



1'24 



'Page 10 



ELEMENTS 



ASSESSMENT PROFILE 
Faculty 1 



,1. 60ALS . 

A. Goals and Objectives 

Total = Assessment Value 

*n, " 

( 

B. Labor Market and Community Needs 

Total . . . ___ = Assessment Value 

. ' » ' 10 



II. PROCESSES 

A. Instruction 
Total . . 



'= Assessment Value 



B. Articulation is Maintained With: 

Total . . .' ' = Assessment Value 

... r _ 

C. Related Work Experience or Equivalent 

Clinical Experience J_sj^ 

Total ... * "= Assessment Value 

• T t 



D. Disadvantaged 
Total . . . . 



Assessment Value 



Y4" 



E. Emphasis on Overconfing Sex Bias, Dis- 
crimination, and Stereotyping Is* 
•Given Jo:. - * 
Total ... = Assessment 'Value 

P. "Counseling, Advising * ' * ; 

Total . = Assessment "Val tie 

-g'v 3 

,* 

G. Placement Services N c 

Total . . /* = Assessment 'Value 

* in* - 4 



H r -Admissions 
Total . 



Assessment Value 



j 



/ r 



EVALUATION SCORE 



- 4 



0.1/2.3 


Model Range 
.4.5 


0.1.2.3 


.4.5 


- f- 

0 . j' . 2 . 3 


.4.5 


— - — , '? 

.0.1.2.3 


. 4 .' 5 


0' 1 : *. 2- * 3 


'. '4 . 5 


'a .' i- . 2 . 3 


. . 4 . 5 


0 12 3 


.4.5 
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0.1.2.3* 


.4 .5 


0 . 1 ' . 2 \ 3 


. 4.' . 5 


.'V . 1 . 2 . 3 


'. A '. 5 
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Assessment Profile 
Faculty 



ELEMENTS 



PAGE. 



Page n 

> f ■ 
EVALUATION SCORE 



III. RESOURCES - ' 

"A. Administration ' „ 

Total ... = Assessment Value 

5— 4 .0_^ 1 . ; 2 ,. 3 



B. Instruction 
"Total \ . 



7 



^Assessment Value • 
7T~~ • 5 . 0.1.2.3 



C. Equipment and Facilities 

Total . . . = Assessment Value 

19 • 

0: Advisory Committees 



6 0.1 .2.3 



Total 



E. Budget 

Total . 



Model Range 



.4.5- 



.4.5 



4 . 5 



«= Assessment Value j, » 

4— 6 ^0 . 1 .»' 2 . 3 



= Assessment Value 
-g— 7 " 0.1.2.3 



4:5, 



4.51^ 
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Page 12 



ELEMENTS 



ASSESSMENT PROFILE 
Faculty 

PAGE 



* GOALS ' 

Written general program goals are: 
Total = Assessment Value 

2 - 

College planning for programs includes: 
Total ... " Assessment Value 

The College educational plan 

• Total ... = Assessment Value 

'2 

Written program objectives are: 

Total ... - Assessment Value 

" ?*" 

Written performance objectives are: 
Total . . . = Assessment .Value 

. "3 

Data on labor market needs are: 
Total . . . = Assessment Value 

T" 

Profession/industry 'standards are: 
Total ... = Assessment Value 

T 

Data on community population needs are: 
Total ... = Assessment Value 

• "3~ • 

Data on job performance requirements are: 
Total . . . - Assessment Value 

Ti" ' . ■ 



\ I . PROCESSES 
IhVtructi 
Total . 



bnal approaches- are adapted to: ■ 
Assessment Value 
T* 

Applicable support courses are: 

.Total ... ~ Assessment Value 

^ -y 

l Articulation is maintained with: 

Total ... - Assessment Value 

Related work experience or equivalent is: 
Total' ... - Assessment Value. 



2 
2 

2 



EVALUATION SCORE 



■ 

0 \ x 2 3 


Model Range 
4 . 5 


0 . 1 . .. 2 . 3 


.4.5 


0.1,2.3 


. 4 .5 


0 » 1.2.3 


.4.5- 


0.1.2.3 


.4.5 


0.1.2.3 


.4.5 


0.1.2.3 


. 4 . . 5 


0.1.2.3 


. 4 fs 


0 . 1.2.3 


.4/5 


0.1.2.3 


. 4 '." 5 ■ 


0.1.2.3' 


T 4- . 5 > 


0 .. 1 . 2 . -3 


* 

. 4-. 5 


• * 

0.1.2.3 


.4.5 



1 2 1 
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N Page 13 



&E&ENTS 



PAGE 



EVALUATION SCORE 



Special services for disadvantaged students 

Total . . = Assessment Value - 

3 m 2 

Special services for handicapped students 
Total . . . -^-Assessment Value 



Special services for reentry student 
Total . . s , = Assessment Value 



Additional services, for students with 
Total . . . = Assessment Value 

Emphasis on overcoming sex bias, etc. 

Total . . . m = Assessment Value 

6 

Counseling and guidance services are 
Total ... = Assessment Value 



Program 
Total 

7 Program 
Total 



includes economic instruction 
. . . = Assessment Value 

ncludes consumer education 
. . = Assessment Value 

Placement of students 

Total . . . = Assessment Value 

3 1 
* Program completers and leavers 

Total . . . = Assessment Value 

3 

Success and failure of program completers 
Total . . . -'Assessment Value 

Students and potential students desiring 

enrollment in. the prdgram 

Total . . . 85 Assessment Value 

~£T~ - 
Promotion of occupational education 

Total. . . = Assessment Value 



III. RESOURCES '* . 

* ' the administrative structure provides-for 
> Total . \ . s Assessment Value 



" 2 
2 
3 
3 
3 
3 
3 
4 
4 
4 

4 
4 



0 . . 1 \ 2 . 3 


Model Range 
.4.5. 


0.1.2.3 


.4.5 


0 . 1.2.3 


.4.5- 


0.1.2.3 


r 

j 

.'4 . 5 


0.1.2.3 


.4.5 


0 . 1.2.3 


.4.5* 


0.1-2.3 


» 

. 4". 5 


0 . 1 . 2 . ,3 


.4.5 


A 1 0 O 

0 1 . £ . 3 


A C 


A 1 O O 

0 1 . 2„ . 3 


A C 


o. . i . r . 3 


* 

. 4 . / 5 


0.1.2.3 


. 4 , . „ 5 


0.1.2.3 


t 

. 4 . *5 


0 . 1.2.-3 


.4.5 
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ELEMENTS 



PAGE 



EVALUATION SCORE 



Administrators and/or supervisors respon- 
sible for directing and coordinating 
Total ... ~ Assessment Value 

~~ 2 

The number of instructors is adequate 
Total . . . = Assessment Value 

'-"T~ 

The instructional staff is qualified by: 
Total ... = Assessment Value 

3" 

The col lege 'encourages and supports 
inservice 

Total . . = Assessment Value 

~3" . 
Support staff are utilized to provide 
Total ... = Assessment Value 

"3 

Equipment used on* campus or off campus 
' is: 

Total . . . = Assessment Value 

3 

Instructional facilities used for the 
program 

Total ... = Assessment Value 

. ~. ' "5 " 

Scheduling of facilities and equipment 
Total ... - Assessment Value 



5 
5 
5 

5 
5 



Instructional materials are: 
Total ... - Assessment Value 

"5 " " " 

Library resources to support the program 
Total . . r Assessment Value 

4" 

Advisory committees 

Tota^l ... ■- Assessment Value 

' 4 '\ 

The operational budget for the program: 
Total ■ • • = Assessment Value 

The capital outlay budget for the program: 
"'Total ... ~ Assessment Value 

"V 7 



* 

0 . 1. . ' 2 . 3 


Wodel Range 
.-4 . : 5 


.0 . 1.2,3 


.4.5 


0 . • 1 . "2 . 3 


. V . 5.' 


0.1.2.3 


.4.5 


0.1.2.3 


.4.5 


0 . 1 ,. . 2 ' . 3 


.•4 . 5 . 


n i 2 3 


4 . 5 


0 12 3 


f 

4 " 5 * 


0 . 1.2.3 


1 

.4.5 , 


0.1.2.3' 


.4.5 


0 . L . 2 . 3 


.4. 5 


0 . 1 . 2, . 3 


* 

.4.5 : . 


0.1.2.3 


.4.5 
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, CHAPTER NINE 
CURRENT STUDENT PERCEPTIONS 



This chapter provides a methodology for gathering students' perceptions 
of their instructors, their program of study, and the .institutional support 
services. The course-Of activities- will follow a sequence similar to that 
outlined" in the Student Perceptions Flow Chart. Two instruments are used to 
gather ^information: 

0 

The first instrument is Student Perception Questionnaire— Instructor 
(Sample Document 3) with accompanying directions for administration (Sample 
Document 1); directions'* for students (Sample Document 2); rating sheet 
(Sample Document 4); and tally fohnat (Sample Document 5). 

The second instrument is Student Perception Questionnaire—Program and 
Ancillary Services (Sample. Document 8) % including directions for , 
administration (Sample Document 6); directions for*students (Sample Document 
7); rating sh$e* (SampVe^Document 9); and tally format (Sample Document 10). 

Both instruments use a five point rating "for .recording responses to 
given statements; and both instruments, provide an additional page for 
written comments. The data are gathered during school time by persons other 
than the instructor. In most instances one class period (50 minutes) has * 
been found to'be sufficient for administering the. instruments. • 

Goals and Objectives . 
Goal s , v " . ' ' 

1. To have current students give their perceptions of the strengths and 
weaknesses of their occupational program and the institution . 
ancillary services. . 

2. to have students give their perceptions of the effectiveness of 
their instructors in the program in which they are currently 
enrol led. , r - 

Objectives - » l 

. The objectives of this chapter ar^aSvfol lowsi 
• K. Provide data for staff, program,, and institutional imRrovement. 
2. Identify curriculum needs. 
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3. 



Identify needed changes or modifications in physical facilities. , 



4. Identify instructional equipment needs. 
* 51 Identify needs in learning resources. 

6,. Provide data frOm which decisions can be made relative to 
program objectives. • 

7. Determine-if >s*udent$ ars informed of program objectives. 

8; Identify student perceptions of strengths and weaknesses in the 
instructional program. * • 

9. Determine if handout materials, audiovisual s, and resource 
materials support the objectives of, the program. 

10. Determine whether that the» ancil lary services (book store, student 
personnel, cafeteria, etc'.) adequately provide for the needs of 
students. 

11. Identify any unmet needs of disadvantaged students that are within 
the purview of the instructor or ^program design. t 

12. Identify any sexual or racial bias in the instructional program or 
in student personnel services. t 



Prior to the commencement of any evaluation activities, the institution 
should designate an institutional Representative to be in charge of 
administration of this component. It is recommended .that this institutional 
represenative be an administrator or supervisor, be familiar with and 
engaged in the day-to-day operation of the occupational programs and 
services, and be able to devote appropriate amounts of time to these 
responsibilities. 



Identify and Categorize Areas ' , 
Surveyed by the Student Questionnaire 

Each institution must consider its information needs when developing or 
modifying survey instruments. The instruments require an internal 
organization to provide usable assessment data. The student questionnaires 



Procedures for Administration- 



Select the Institutional Representative * 
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4. 



presented here assess a variety of areas and are organized as shown: " 
"Student' Perception Questionnaire— Instructor 11 (Sample Document- 3)' * 
—Methods of Instruction Questions 1-4 
— Instructor Effectiveness Questions 5 - 7. 
—Additional Comments Question 8 

"Student Perception Questronnaire—Program and Ancillary Services" 
(Sample Document 8) * * 

—Curriculum Questions 1 - 5 

4 --Learning Resources-Questions 6-7 

--Physical Facilitates Questions 8-9 

--Ancillary Services Questions 10 - 14 

--School Maintenance Question 15 

--Additional Comments Question 16 

^Prepare for Administration 

Planning is essential to a well-conducted survey of student perceptions. 
Standardization of procedures ensures the least amount of confusion and a 
more positive orientation to the effort. In preparation for the current 
student survey, the following 'activities should be the responsibility of arid 
be conducted by the designated institutional personnel. 

1 . Institutional Representative ^ 

a. Helps .familiarize those invol ved in the evaluation process with 
the principles and concepts of the evaluation and works toward a 
commitment from them. 



b. Familiarize himself/herself with the various manuals, forms, 
instruments, etc*, and is an available resource to those who 
will be using these materials. . 

c. Reviews with, department chairperson and other appropriate 
personnel (instructors, etc.) the student questionnaires and 
modifies the instruments according to local needs. 
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\ 

d. 'Works wjth appropriate institutional personnel (instructors, , 

department chairperson), in irranging the time most appropriate 
for conducting the survey, ensuring that as many students as 
possible y/ill be available to complete the questionnaires. 

e. Assumes the responsibility for training additional institutional 
^personnel to aid in the administration of the student perception 

questionnaires, if additional aides are needed. 

f. Consults with program instructors to anticipate the number* of 
student questionnaires needed. 

g. Obtains identification numbers for th6 program and all 
instructors involved. The test administrator takes -appropriate 
identification numbers to each session for proper placement on 
the rating sheets. 

h. Surveys each department independently. 

i. Delivers completed rating sheets to "computer station for - y 
data processing or provides for hand tallying and recording of 
results. Provides for typing of written' responses. 

j. Forwards accumulated data t to the department chairperson for 
review with appropriate personnel. 

■0 

Department Chairperson 

a. Works with the institutional representative, instructors, 
and other appropriate personnel in arranging the time for 
administration of the questionnaire. Assists with 
administration of the questionnaires when requested. 

b. Promotes a positive attitude toward the evaluation effort. 

c. Meets individually with each instructor to relay the 
results of the student questionnaires.. • ' 

. - ✓ 

d. Conducts summary conference with all program instructors to 
discuss student perceptions of program. 

e. As a result of the summary cenference, records all 
identified individual and program needs. 

f. Develops with the instructor an appropriate methodology to meet 
the needs that may have been identified. 
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' 3 V Instructor 



a. Advises students that the survey will be administered on the 
scheduled date, emphasizes the importance of their responses, 
and helps create a receptive and positive attitude toward the 
questionnaire. , 

b. Arranges lesson plans for ltfSst interruption* 

c. Arranges for own absence from the classroom during the 
administration of the questionnaire. 



List Materials Needed * 
--Sufficient number of student questionnaires 
v --Sufficient number of rating Sheets 

--Directions for administering instruments 

--Extra pens (pencils) 

— Large envelope for student rating sheets 

Review General Guidelines for. Administration of Student 

Questionnaire ' % 

The following guidelines must be given full consideration in 
administering the questionnaire: 

1. Any and .all actions or statements by the administrator of 
the questionnaires may "i nf 1 uence the students 1 responses. 

2. The administrator must express a positive attitude toward 
the survey while in the presence of the Students and 
emphasize the importance of factual responses. 

3. Al V directions must be clear and concise to secure the full 
cooperation of the students in gathering the needed data. 

4. -It is suggested that every effort be^made to survey each 
student in the occupational program. However, if the 
population is too large to survey each student, it is 

•recommended that a representative sample be drawn., 

5. Instructors should not be present during administration of the 
questionnaire. 
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6. Each student flTTfst complete a*"Student Perception £ 
Questionnaire— Instructor" for each instructor. - 

« 4 

Follow S pecific Procedures for Administration of the Instruments 

The institutional representative or aide is to administer the student 
perception questionnaire as follows: 

i: Explain briefly the student perception questionnaires and 
the intended use /of the data. ' 

2. Assurfe students- of the tonf idential ity and importance of 
their responses. 

3. Encourage students to respond to all items in -spite of the 
• difficulty some items may present. 

4.. Write the program/number and 'each instructor's position 
•number on, the board. Explain that for confidentiality 
instructor and program numbers are used instead of names. 

5. Ask studertts to mark only on the rating sheets. The survey 
instruments are reusable if kept clean. 

6. Ask students to read the directions silently while the administrator 
reads them aloud. 

Procedures for Data Analysis - >g. 

The purpose of this section is to provide suggestions for synthesizing 
the data collected through the student perception questionnaires into an 
understandable and usable format. * 

Tallying 

\lhe rating sheets are designed for computer or hand tallying. If 
comduter facilities are used, a program may be developed, to process the 
datal .If hand tallying is used, refer to instructions located on hand tally 
fOrms\. * , * , 

The written cdmments recorded by the respondents should be typed 
verbatim. No /identifying information is to be recorded. The utmost * 
conf iderrtiality must be observed by the person(s) working .with these 3 
questionnaires. - 
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Ana1yz\ng Data ^ 

The fqllowing list provides suggested step? for data analysis. 
Individual institutions may need' to adapt or modify the steps to meet their- 
needs. . ' \ 0 i . 

—Tally instruments 



-'-Typ* verbatim -thp/written comments 
—Deliver rating sheets to computer station for processing ^ or , 
—Provide -for hand' tallying, ancj recording, of Vesults 



—Forward accumulated data to department chairperiroTfjor review with 
-appropriate personnel. 

- , ^ - t* 

Using the Data ■ * ^ 

The primary purposes of this total evaluation model is,f<Ar individual/ 
program, and institutional improvement. In order for the^fata gained from 
the'process in this document to be meaningful, £hp date must be u$ed. Itjs 
extremely important that all concerned parties be informed of^the results 
and the implications for improvement. * ( 

* < 
Student Perceptions Flow Chart ^ 

• , The flow chart on the following page porlrways the ^roce^^^r 
student perceptions, anal/zing the data, arjd using the information./.^ 
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fisting of Sample Documents - 

Document Number Document Name 

1 , Student Perception Questionnaire-- : 

Instructor (Directions for 
^ ' Administration) 

2 Student Perception Questionnaire— 

' * ^ Instructor (Directions for Students) 

i •/ 3 Student Perception Questionnaire-- 

/ Instructor 

4 ' Student Perception Questionnaire- 

Instructor- (Rating sheet) 

5 Student Perception Questionnaire- 
Instructor (Tally Format) 

6 Student Perception Questionnaire—" ■ 

Program and Ancillary Services 
(Directions for 'Administration) 

7- Student Perception Questionnaire— , 

Program and Ancillary Services 
(Directions for Students) 

r 6 Student Perception Questinnaire— 

' Program and Ancillary Services 

9 * Stddent Perceptions Questionnaire- 

Program and Ancillary Services (Rating 
Sheet) 

10 .Student Perceptions Questionnaire- 

Program and Ancillary" Services 
(Tally Format) 

11 * • Alternative Instrument 
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STUDENT PERCEPTION QUESTIONNAIRE— INSTRUCTOR 

(IHrcGtsiomi f*n\ Acbniniat ration) 



'This questionnaire is designed to give you an opportunity 
to express your views concerning the effectiveness of your 
instructor(s) and the type instruction you are receiving. 
The purpose in asking for your perceptions is to assist 
the school and' your program in making needed improvements. 
Therefore, you are asked to read the questions carefully 
and answer them as honestly as you can. 

• You have been given a "Student Questionnaire—Instructor 
Rating Sheet on which to mark your responses < Now turn 
to this Rating Sheet. ()\mtu- $ hold aj> "xtufont .-.tioh>iait 
Instructor" f\it<'wj rhcrt .mil check L> c< c that >iU nidi-fonts 
ha ve t h * cor rwi' do<> nam *n t ) 

At tHis-time., enter Instructor Position Number (one sheet 
for each instructor you havel) , Department Number, -(Point 
to identifying numbers on blard) and the Quarter ii^ which 
you are currently enrolled in the appropriate blanks at 
the top of the rating sheet. (Stnt 3 aVov iim* for entevina 
information.) i, * 

Turn back to the cover sheet arid resume reading silently 
while I read aloud. 



The Evaluation' Scale ranges from numbers^O through 5,*" 
with five .(5) being the highest rating and one (1) the 
lowest. Circle the number you feel to be your best response 
to each question. If you believe the question does not 
apply, or you have insufficient information to* respond, 
please^circle "0" . Attached is a page for any written 
comments you wish to make. 

All information is CONFIDENTIAL. You do not have to. , 
sign' your name unless you wish to do so. 

Plea:se remember: Do not mark on the^questionnaire. Write 
only on the rating -sheet provided. 

You are to mark only one'answer to each question. I f you 
mark more than one response, your response will not be 
used: If you wish to change a particular response, please 
completely remove the undesired response and circle the most 
appropriate answer. 

I3 V - * . 
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Let's complete the example. 
: - J~ 



Evaluation Scale 



5 Almost Xl ways 

4 — Often 

3 Sometimes 

2 Seldom 

1 Almost NeVer 

0 — Not Applicable 



EXAMPLE: "I haVje received the grades I have earned." 
Using the preceding evaluation scale, circle the number 
that most accurately reflects your feelfngs. 



Dd you have any Questions? Please start completing the 
questionnaire. If you have any questions, raise your 
hand. 

Monitor the room tp see that students are proceeding 
correctly. Uioe personal assistance to students who 
ask for .help or appear to be having difficulty % v 
completing the- forms in the group situation. 

As students complete\the qv^estionnaires > collect 
questionnaires, rating sheets* pencils^ etc. Place 
Ike rating sh'eets in confidential envelope. 
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Sampl e Document 2 



STUDENT PERCEPTION QUESTIONNAIRE-- INSTRUCTOR - 
(Dire'ctions for Student) 

This qiflestionnaire is designed t9 give you an opportunity to express your 
views concerning the effectiveness of your instructor(s) and the^^pe 
instruction you are receiving. The purpose in asking for your perceptions 
.is to assist the school and your program in making needed improvements. 
Therefore, you'are asked to fead the questions careful ly and answer t them as. 
honestly as you can. , 

You have been given a "Student Questionnaire—Instructor" Rating Sheet on 
which to mark your responses. Now turn to this Rating Sheet. At thi* time,, 
enter instructor position number, department number, and the quarter in 
which you are currently enrolled in the appropriate blanks at % tlie top of the 
ratinj sheet. The Evaluation Scale ranges from numbers 0 through 5, with 
five (5) being the highe$t rating and one (1) the lowest. Circle the number 
you feel to be your best response to each, question . If you believe the 
question does not apply, or you have insufficient information to respond, 
please circle "O". Attached is a page for any written consents you wish to 
ma He. 



All information is CONFIDENTIAL, 
you wish to do so. 



You do not have to sign your name unless 



Please remember: 
sheet provided . 



Do not mark on the questionnaire. Write only on the rating 



You afe to mark only one answer to each question. If you mark more than one 
response, your response will not be used. If you wish to change a particular 
response, please completely remove the undesired response and circle the most 
appropriate answer. 



Evaluation Seal e 

5 Almost Always 

4 ^- Often 

3 Sometimes 

2 — Seldom 

1 Almost Never 

0 "-- Not~Appl icable 



Example': I have received the tjrud^s T have earned. Usiing-cfche preceding 



igx^ne 

Evaluation Scale, circle the number that most accurately refTe 
feel ings. ' 



ects your 



1 



\ 
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Sample Document 3 



STUDENT PERCEPTION QUESTIONNAIRE 
INSTRUCTOR 



There should be effective communication betwden the instructor and 
student. How would you rate your instructor in the following areas 
■ of communication? • / 

- a. The instructor makes me aware of my progress. 

. b. The instructor explains what is right or wrong about 

assignments or work. , 

c. The. instructor assigns learning activities to improve my 
performance. 

The instructor who applies variety to teaching methods uses many 
types of materials' to assist learning. Rate your instructor as to 
the use of: 

a. Guest speakers 

b. Special class activities 

c. Field trips" 
d* Audiovisuals 

e. Printed handouts J . , ' ^ 

* * 

Knowl£tage of your progress is of utmost importance in a learning 
situation. How would you .rate your instructor in the following 
areas? ' * 



Grading procedures are clearly described. 

a. Instructor clearly indicates what material tests 'will cover* 

i 

b. . , Tests are graded within a reasonable time. 

c. I am given an opportunity to review my test results with my 
instructor. 

Classes should begin and end at a scheduled time and the instructor 
should be present and available td assist students. How would you 
rate your instructor in the following areas? * 
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a. Classes and laboratories -begin at the scheduled time. .Page 2 

b. Students are dismissed at the scheduled time. 

c. Instructor is present when classes are in session. 

d. Instructor is available to assist when classes/laboratories 
are in session. 

5. Subject matter must be presented in an organized manner. How would 
you' rate your instructor in the following areas? **> 

• * • 

a. Subject matter is presented in an order that helps me 
understand it. 

"» 

b. % Instructor stays on subject or related material and does 

not waste class time on unrelated material. 

c. Directions for assignments are clear and easily understood. 

d. Assignments made by my instructor are relevant to the subject 
matter. * 

g. I have enough time for completion of assignments. 

f. The instructor is well prepared to conduct classes/laboratories . 
each day. 

6. The instructor should be fair when working with students. How would 

you rate yoiir instructor in the following areas? - / 

a. I have received the grades I earned. 

* b. I receive a fair share of the instructor 1 * time. 

c-. The instructor makes class assignment? that apply equally to 
all persons. 

7. Human relations are of extreme importance to the succe.ss of the program. ; 
Please rate the following concerning the human relations between you 

and your instructor: 

a. My instructor is considerate and tolerant of my opinions. 

b. My instructor' gives me personal attention when needed. 
c t My instructor is courteous. 

d. My instructor displays sel f-control . 

e. ty. instructor gives me criticism in a courteous and helpful manner'. 
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f. 'My instructor encourages me to ask questions. Page 3 

g- The instructor .responds to my questions in'«a considerate and 

.-courteous-jnano^-^ . • 

h. I feel that my relationship with my instructor is not 
influenced because I am male or female. 

i. >I feel thajt my relationship with my instructor is not 

influenced because of my particular race. 

j. I feel that my relationship with my instructor is not 
influenced because of my age. 

Use this page to explain a particular response or comment upon any 
subject not covered by the questionnaire. 



COMMENTS : 
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Sample Document 4 



DATE: 



PROGRAM NO. 



STUDENT PERCEPTION QUESTIONNAIRE-- INSTRUCTOR ■ 
RATING SHEET 



QUARTER IN WHICH YOU ARE CURRRENTLY 
ENROLLED: 

1 2 3 4 



INSTRUCTOR NO. 



8 



RATING SCALE 



1. (a) 
(b) 
(c) 



5 

Almost 
Always 

5 
5 
5 



4 

Often 

4 
4 
4 



3 • 2 " 
Sometimes Seldom 



3 
3 
3 



2 
2 
2 



1 

Almost 
Never 

1 

,1 
1 



0 

Not 
Applicable 

0 
0 

0 . 







« - 










2. (a) 


5 


4 


• 3 


2- 


1 


0 ■ 


(b) 


5 


4 ' 


3 


2 


i 


0 " 


(c) 


5 


4 


3 


' 2 


1 


0 


(d) 


5 . 


4 


3 


2 


1 


■ or ' , 


(e) 


5 


4 


3 


2, 


1 


o ' • 


3. (a) ' 


5 


4- 


3. 


2 




0 ■ 


- (b) - 




4 


3 


2 


1. 


0 


(c) ' 


5 


4 . 


3 


2 


1 


0 < 


(d) . 


5 


' 4 


3 . 


2 • 


1 


0 " 



4. (a) 


5 


4 


. 3 


2 


1 


0 


(b). 


5 ••* 


<4 


3 


2 


1 


0 


tc) 


-5 


4 


•* 3 


2 


1 


0 


(d) 


5 


' 4 

a 




2 


1 


0 


5. (a) 


5 


4 


, 3 


2 , 


1 


• 0 


(b) 


5 


4 


. 3 . 


• 2 


1 


' 0 


(c) 


5 


' .4 


3 '■ 


2 


'1 


v 0 


(d) 


5 


4 


3'* 


• 2 


1 


0 


M 


5 


■ . 4" 


' T 


2 


,1 


0 


(f) . 


5 


4.' 




,Z 


■ 1 


. 0 



140 



146 



.Student Perception Questionnaire— Rating Sheet 
Page 2 ... 



7. 



(a) 
(b) 
(c) 
(d) 
(e) 
(f) 

(g) 

(h) 
(i) 
(j) 



Almost 
Always , 



4 

Often 



Sometime's 



2 

Seldom 



1 

Almost 
Never 



6. (a) 


f 5 


4 


3 


2 


1 


(b) 


5 


4 


3 


2. 


1 


(c) 


" 5 


'4 


' 3 


2 


1 


(d) • 


5 


4 


3 


2 


1 



Page 2 

0 

Not 
Applicable 



0 
0 
0 
0 



5 


4 


3 


2 


1 


0 


5 


4 


3 


2 


1 


0 


5 


4 


. 3 


2 


1 *. 


.0 


5 


4 


3 


2 


1 


' 0 


5 


4 


3 


2 


1 


0 


5 


4 


3 


2 


1 


0 


5 - 


4 


3 


2' 


■ 1 


0 


5 


4 


3 


. 2 


1 


0 


5 


4 


3 


2 


■1 


0 


5 


4 - 


3 


2 


1 


0 



ERIC 



141 

147 



STUDENT-PERCEPTION QUESTIONNAIRE— INSTRUCTOR 
SUGGESTED TALLY FORMAT 



V 



CO 
3 



EACH QUESTION NEEDS A BLOCK FOR' INDICATING RESPONSES. ADD YOUR RESPONSES IN EACH SECTION TO GET AN OVERALL 10 
PICTURE OF STUDENT PERCEPTIONS. TALLY SHEETS FOR EACH SECTION COULD BE DEVELOPED MUCH LIKE THOSE BELOW. 5 



Method o'f Instruction 



1. 


5 

Almost 
Always 


4 

Often 


3 

Sometimes 


2 

Seldom 


1 

Almost 
Never 


. T o 

Not 
Applicable 


Totals 


v Mean 
Response 


a. 


















• b. 


•> 
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L... 
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e. 
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* ' Sample Document 6 . 



STUDENT PERCEPTION QUEST IONNA.I RE — ^ROGRAM AND -ANCILLARY SERVICES 



9 

ERLC 



(Directions for Administration) 



c? • 

tf£Vi; This questionnaire ; is designed to give you an opportunity 

to express your views concerning the effectiveness o'f the 
n * occupati^r^l program in which you are s enrolled and the / 

ancillary services of the institution. The* v purpose jta |~ 
asking* for your perceptions is to assist. your program 
and the school in meeting the needs of stude$£*. There- 
fore you are asked to read the questions caref«+H and^C/O* • 
answer them as honestly as you ^tfrT>^ ^ y \f^y^ K> ^ 

READ You have 'been given a "Student Quesfcronnai re— Program ^ 

and Ancillary Services" rating sheet on which to circle/ 
your responses. Now turn to this rating sheet, (Pause * ^ ' 

hold up appropriate Hating Sheet and check to see that k 
all students riavc the correct document.) 

SAY A.t this time, enter the date, program number, (Point to * * 

number oh bhard) and quarter in ,whicl*| y6u' are enrolled 
in the appropriate blank on top of the rating. Sheet. ; 

(Stop — Allow time for entering information*) ' ^ * 

HEAD ' The evaluation scate ranges from numbers 0 through 5 
with five (5) being the highest rating andone (1) the 
lowest. Circle the number you feel to be yourlbest 
1( ' respqjise to each question. If you believe the question 
does not apply, or you have insufficient information' to 
respond, please circle "0". Attached is also a page for 
any written comments you wi^v to make. 

READ .Please remember: Do not mark on the questionnaire. ^hf 

Write only on the rating sheet provided. ' k 

'hEAif You are to mark only 6n£ s answer to each qui^tion. If 

you mark more than' one response, your response wiT 
be used. If you wish td' change a particular response, 
please completely remove the undesired response and 
circle the most, appropriate answer. 
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Evaluation Scale 


5 


— Almost Always •' 


4 


— utten 


3 


Sometimes : 


2 


— Seltfom 


1 


Almost Never 


9 


— Nat Applicable 



Let's complete the, examples. 
EXAMPLES 

The temperature is adequate in the classroom. 

(Circle the t answer that most accurately reflects your 
feelings. ) 

\ * ' 

5 * 4.3 2 1 ' 0 

Some questions have a "yes 11 or "no" answer. Circle 
the response you wish to make. 

I received an introductory orientation of my program 
when I enrolled. (Circle the answer that most accurately 
reflects your feeHngs. 



Yes 



No 



Do you have any questions? Please. start completing 

the questionnaire. If you have any questions, please ^ 

raise your hand. * 

Monitor the' room to see tiiat cpudents are proceeding 
correctly. ■ 

As students complete the questionnaires, collect the 
sealed envelopes containing their responses. Collect 
the' questionnaires^ pens, and other materials. 



1 A A 
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* Sample Document 7 

STUDENT PERCEPTION QUESTIONNAIRE -PROGRAM AND ANCILLARY SERVICES 

(Directions for Student) 

This questionnaire is designed to give you an opportunity to express your 
. views concerning tffe effectiveness of the occupational program in which you 
are enrolled and .the support services of the institution. The purpose in 
asking for your perceptions is to assist your program and the school in 
meeting the needs of students. Therefore you are asked to read the questions 
carefu.lly and answer them as honestly as yqu can. 

You have been given a M Student Perception Questionnaire—Program and Ancillary 
Services" Rating Sheet on which to circle your responses. Now turn to this 
Rating Sheet. 

At this time, enter' the date, program number, and quarter in which you are 
enrolled in -the appropriate blank on top of the rating sheet. 

The evaluation scale ranges from numbers 0 through 5, with five (5) being the 
hjghest rating and one (1) the lowest. Circle the'number you "feel to be your 
best response to each question. If you believe the question does not apply, 4 
or you have insufficient information to respond, please circle "O 11 . Attached 
is also a page v for any Written comments you wish to make. 

Please remember: Do not mark on the'questionnaire. Write only on the rating 
sheet provided. 

You arp to mark only one answer to each question. If you mark more, than One 
response, your response will pot be used. If you wish to change a particular 
response,, please completely remove the undesired response and circle the most 
appropriate answer. , - 





* • 


Evaluation Scale 


5 


r- Almost Always 


• 4 


-- Often 


3 


-- Sometimes 


' 2 


Seldom 


1 


-- Almost Never • 


0 


-- Not Applicable 
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EXAMPLES ' ~ 

> 

The heat is adequate in the classroom. (Circle the number that most 
accurately reflects your feelings.) 

-5 4 3 Z , \ o" 

Some questions have a "yes" or "no" answer. Circle the response you wish to 
make.- • 

I received an introductory orientation of my prajram lihen T enrolled. 
(Circle the answer that most accurately reflects' your feelings.) 



Yes 



No 
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Sample Document 8 

STUDENT PERCEPTION QUESTIONNAIRE 
Program and Ancillary Services 

The student objectives of a course or instructional program tell what the 
student will know or be able to do upon completion of a lesson-, course, 
or an entire program. How do you rate the following? 

a. I have been informed of the objectives for each course and/or the 
entire program. •> 

b. Objectives are in a written format are clear and easily understood. 

c. The objectives are written without regard to any particular race. 

d. The objectives are written without regard to any particular sex. 

e. The instruction I receive supports the objectives -specified. 

Printed hand-out materials are important learning tools. How would you 
rate the following? 

a. Printed hand-outs are used as a learning -tool in this course. 

b. Printed hand-outs support the objectives of the lesson.- 

c. Printed hand-outs are written in a manner that is easilylunderstood. 

d. Printed hand-outs are of good quality. 

e. Printed hand-outs are developed so that they apply to both male and 
female students. 

f. Printed hand-outs are developed so that they apply to all students 
regardless of race. 

Lab projects and exercises should be selected and arranged to stimulate 
the student to think, and apply what they have learned. How do you rate 
the following? « . 4 

a. Laboratory projects and exercises are used in this course* 

/ . 

b. Time requirements for completion of laboratory projects and exercises 
are clear and complete. 

c. 1 am able to successfully perform laboratory projects or exercises 
using the skill and knowledge that I have gained from'rtiy studies. 



154 



Student Perception Questionnaire Page 2 

Program andAnctllary Services 

f 

3. d. Directions for laboratory projects and exercises are clear and complete. 

e. Adequate supplies are available to support laboratory projects and 
exercises. 

f. A sufficient quantity of equipment is available to support the 
laboratory projects and exercises. 

g: EquipmentJs in proper wprking order, 

h. I feel that lab exercises are designed so that they app5^ to all 
students regardless of race. 

i. I feel that lab exercises are designed so that they apply to both 
male and female students^ 

* 

4. An up-to-date training program teaches relevant and ^current practices as 
they exist in business and industry. How do you rate the following: 

a. Occupational practices taught in your program are up to date. 

b. Equipment used in your program is up to date, 

, # 

5. A well -organized departmental orientation helps new students feel 
comfortable and begins preparing them for their chosen career field. 

Did your orientation conducted by your instructors include the followinq? 

a. Printed copy of ; school policies, 

b* Printed copy of departmental rules and regulations. 

. c. Introduction to departmental instructors), 

d. Overview of all courses Jn the curriculum-. 

e. Information regarding potential job opportunities in your field. 
m f<r -Tour of the department. . ' 

g. Identification of the program objectives. 

h. Applicability to both male and female students, 

i. Applicability to all races of students. 

j. Identified other school personnel who Could assist me with such 

things as financial aid, registration, and other kinds of problems, 

... / 
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/ Student Perception Questionnaire 
Program and Ancillary Services • 



Page 3 



6. Audiovisuals are an important ^learning tool when used where they assist, 
learning. How do you rate the following? 

a. Audiovisual^ are used as a learning tool in this course. ' S 

b. Audiovisuals support the, student objectives. 




c. Pictures are clear and easily understood. 



d. 



The voice is clear and holds my interest. 



e. The methods used in the visuals are Consistent with those taught in 
the course. 

f. Audiovisuals are readily for nay individual use. 

g. Audiovisual equipment is in proper working order. * - 

* 

h. I have been given instruction in the use of audiovisual equipment. 

i. t I feel that audiovisuals are developed so that they apply to both 

male and female students. 

j. I feel that audiovisuals are developed so that they apply to all 
students regardless of race. 

7. Reference books and' other materials are important learning tools. How 
da you rate the following? 

a. A variety of reference materials is available for the program of 
study in which I am enrolled. 

b. 'A sufficient amount of reference books and materials is available. 

c. Reference materials are easily accessible to students. 

d. Reference materials are written in an understandable manner. 

e. Textbooks used in the program appear to be up-to-date. 

f. * Reference materials appear to be up-to-date. 
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Student Perception Questionnaire Page 4 

Program and Ancillary Services 

8. A good learning environment requires a quiet area for study* How do you 
rate the following? * . 

a. A quiet study area is available for my use, _ 

b. There are a minimum of distractions' in the study area to allow con- 
centration on the subject matter. 

c. The study area is organized in a manner that helps me to concentrate 
on subject matter. 

9. ^ Physical facilities should be designed and arranged to contribute to the 
" achievement of the program's purpose. How do you rate the physical 

facilities in your program? If any response to the following questions 
is flo, please identify the room number and explain the need on the 
"Comments" page. 

a. All classrooms have adequate space. 

b. The shops or laboratory areas have adequate space. 

c. All classrooms^ have adequate light. 

d. The shop or laboratory area l)as adequate light. 1 

e. All classrooms have adequate temperature control i 

f. The shop or laboratory has adequate temperature control. \ 

g. The shop or laboratory area has adequate ventilation. 

h. The classroom has adequate ventilation. 

i. -Classroom arrangement contributes to safe performance. 

j. Shop or laboratory arrangement contributes to safe performance. 

k. Adequate provisions are made for handicapped students with special 
needs. , % 

Please respond to the following statements concerning the school bookstore. 

a. Bookstore is open at convenient times. 

b. The bookstore contains an adequate supply of the materials I need. 

c. I was treated courteously while conducting business with bookstore 
personnel. 
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Student Perception Questionnaire Page 5 

Program and Ancillary Services 

11. Please respond to the following statements concerning student personnel 
services offered to you at your school. / 

* 

a. The admissions office provided me with adequate information about 
various training programs, available prior to my enrollment in the 
program, - :m ' ' 

b. * I received an introductory orientation of the program and school 

from the admissions office when I enrolled, 

c. I was treatetTcourteously and fairly during the admissions procedure. 

d. I received information about various financial aid programs available 
through the school . 

e. I was, informed about job placement services available sit my school. 

f. The student personnel services are administered equally to male and 
female students. 

g. ' The student personnel services are administered equally to all 

students regardless of race. 

h. I received a student handbook that contains the- policies, rules, and 
regulations by which I am to abide. 

i. I m aware that counseling services are available in the Student 
Personnel Office. 

12. Please respond to the following statements concerning the school cafeteria. 

a. The prices charged for the food are reasonable. 

b. The food served is of high quality. 

c. A good variety of food is served in the cafeteria. 

d. A high standard of cleanliness prevails in the cafeteria. 
The serving line moves as rapidly as possible. 

f* The cafeteria personnel are friendly and courteous. 

13. Please, respond to the following statements concerning registration : 

a. Registration is conducted in an organized manner. 

b. The time required for registration is reasonable. 

c. IndividuaTassistance is given if needed. 
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Student Perception Questionnaire page 6 

Program and .Ancillary Services 

14. Please respond to the following statements concerning the Veterans 
Administration Program: < 

a. >The Veterans Administration representative is available for assistance 

with problems. * 

b. The Veterans Administration representative is courteous. 

c. Problems are handled as quickly and efficiently as possible/ 

15. Please respond to the following statements concerning the institution, 
a. The appearance of. the building is attractive. ~ 

^ b. The halls have adequate walkirrg space. 

c. The restrooms are clean. 

d. Adequate restroom supplies are available. 

< 

e. Adequate lounges are provided for students. 

r 

f. Entrances to the building are maintained in an attractive condition. 

g. The school has adequate provisions for handicapped students to enter 
buildings. 

16. Use* the page attached to your rating sheet to explain a particular 
response or comment upon any subject not covered by the questionnaire. 
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Sample Document 9 



.DATE: 



PROGRAM NO. 



STUDENT PERCEPTION QUESTIONNAIRE-PROGRAM AND ANCILLARY SERVICES 

'RATING SHEET 



QUARTER IN WHICH YOU ARE CURRENTLY 
ENROLLED: 

1.2' 3 4 



INSTRUCTOR NO. 



5' 



7 



8 



RATING SCALE: 



(a) 
(b) 
(c) 
(d) 

(e) 



Al-mcst 
Always 

5 
5 
5 
5 
5 



\ 



4- 



4 

Often 

4 
4 
4 
4 
4 



3 2 Almost 

Sometimes Seldom Never 



3 
3 
3 
3 
3 



2 
2 
2 
2 
2 



Q 

Not . 
Applicable 

0 

' 0 
0. 
0 
0 



2. (a) 
(b) 
(c) 
"(d) 
' (e) 
(f) 



5 
5 
5 
5 
5 
5 



4 
4 
4' 
4 
4 
4 



3 
3 
3 
3 
3 
3 



2 

2 
2 
2 
2 
2 



0 
0 
0 
0 
0 

-o 



3. 



(a) 
(b) 

M 
(d) 
(e) 

.(f) 

(g) 
(h) 
(i) 



(a) 
(b) 



5 
5 
5 
5 
5 
5 
-5 
5 
5 



4 
4 
4 
4 
4 
4 
4 
4 
4. 



4 
4 



3 
3 
3 
3 
3 
3 
3 
3 
3 



3 
3 



2 
2 
2 
2 
2 
2 
2 
2 
2 



0 
0 
0 
0 
0 
0 
0 
0 
0 



0 
0 



(a) 
(b) 



Yes 

Yes 



No 
Nn 
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Page 2 ' 
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5 


t 


3 
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o 


(e) 


5 


4 


3 


2 • 1 


- 0 


(f) 


5 


.4 , 


3 


2 1 


* ' 0 


8. (a). 


5 


4 


3 


2 1 


p 


(b) 


5 


' . 4 


3 


2 1 


0 


(c) 


5 


4 


3 


2 v 1 


0 
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0 


(e) 
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10. (a) 

' (b) 
(c) 



•Program and Ancillary Services 



Page 3 



5 ' 
Almost 
Al ways 

5 
5 
5 



4 

Often 

4 
4 
4 



Sometimes 

3 
3 
3 



1 



0 

2 /~s^\ljD0St Not 
Seldom Never Applicable 



2 
2 
2 



0 
0 
0 



11. 



(a) 
(b) 
■(c) 
W 
(e) 
(f) 

(g) 

(h) 
(i) 



5 
5 

5 
5 
5 
5 
5 
5 



4 
4 
4 

~4~ 
4 
4 
4 
4 
4 



3 

3- 

3 

3 
3 
3 
3 
3 



2 
2 
2 

T 
2 
2 
2 
2 
2 



1 
1 
1 

T 
1 
1 
1 
1 
1 



0 
0 
0 

-o- 

0 
0 
0 
0 
0 



12. 


(a) 


5 


• 4 


3 


2 


1 


0 




(b) 


5 • 


4 


3 


2 


1 


0 




(c) 


5 


4 


3 


2 


■ 1 


0 




(d) 


5 


4 


3* 


• 2 


1 


0 




(e) 


5 


4 


„ 3 


2 


• 1 


0 




(f) 


5 


4 


3 


2 


1 


0 




(g) 


5 


4 


3 


2 


1 


0 




(h) 


5 


4 


3 


-' 2 


1 


0" " 




CO 


5 


4 


3 


2 


1 


-0 


13. 


(a) 


5 


4 


3 




i 


0 




(b) 


5 


4 


3 


2 


i 


0 




fc) 


5 


' 4 


. 3 


2 


i 


0 


14. 


(a) 


5 


4 


3 




I 


0 ' 




(b) 


5 


4 


3 


2 




0 . 




<c) 


5 • , 


4 ■ 


3 


. • 2 


i 


0 



15. 



(a) 
(b) 
'(c) 
(d) 
(e) 
(f) 

(g) 



5 
5 
5 
5 
5 
5 
5 



4 
4 
4 
4 
4 
4 
4 



3 
3 
3 
3 
3 
3 
3 



2 
2 
2 
2 
2 
2 
2 



1 
1 
1 

U 
1 

b 



0 
0 
.0 
0 
0 
0 
0 
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Page 4 
COMMENTS: 




) 

^.156. 



SfUDfNT PERCEPTION QUESTIONNAIRE '.PROGRAM' AND ANCILLARY SERVICES 

SUGGESTED TALLY FORMAT . 

1 ^ • 



^^S^P^SfoS" ^TALLY^SHEETSFOR^EAfH ^r.^P 1H EACH SECTI0N T0 GET AN OVERALL 

rtKtmiUNb. TALLY SHEETS FOR EACH SECTION COULD BE DEVELOPED MUCH LIKE THOSE BEkOW. 



CurrMcul 



urn 



5 1 0 

; ;] most j 3 2c Aim °st Not 

Always Often . Sortietii 
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imes Seldom Never Applicable Totals 



Mean 
Response 
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b. 






< 






4^ 1 







165 



ALTERNATIVE INSTRUMENT 



Thcfol lowing instrument has been adopted from the California Community 
College Occupational Program Evaluation System (COPES) by Olympia Technical 
,Community College in "Washington. 
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STUDENT PERCEPTIONS OF OCCUPATIONAL PRGRAM 



College 



Title of this course 



Your college is studying its occupational education prpgrams to learn how to make them better for present and future students. 
We are very interested in student veiws. Only students who are majoring in an occupational program (for example, registered 
nursing, automotive technology, secretarial science and similar programs) should complete this form. You need not sign the form 
but we do need to know the name of your college and the occupational course you are taking. 

INSTRUCTIONS: After each item below check YES, if in your, experience it is most often the case or NO, if it is rarely or never 
so. Then, rate the item as follows: EXCELLENT means nearly ideal, top 5 to 10%, GOOD is a strong rating, top one-third; 
ACCEPTABLE is average, the middle third^ELOW EXPECTATIONS is only fair, bottom one-third, POOR is seriously inadequate, 
bottom 5 to 10%. ' 
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1. Courses in your occupational program are: 
4 Available and conveniently located , 
' • Based on realistic prerequisites 

• Based on fair selection procedures 

♦ 

2. Written course objectives: 

• Are available to students 

Describe what you will learn in this course 

• *Are used by the instructor to keep you aware of your class 

progress 

• Provide practical application experience as a part of instruction 

3. Teaching methods, procedures and course content: 

. • M^et your occupational needs, interests, and objectives . 
. • Provide practical application experience as part of 
instruction. 

4. Related courses (such as English, mathematics, science are: 

• v Coordinated with occupational instruction 

• Current and meaningful to you . . * 
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5. Work experience (or clinical experience in your 
occupational program is: 

• Readily available at convenient locations 

• Readily available to both day and evening students 

• Coordinated with classroom instruction 

• Coordinated with employer supervision 

6. "Economic instruction provided in your program has 

helped you: " 

• Understand your responsibilities and rights as an 

employee 

• Evaluate job opportunities in relation to salary, 

benefits, conditions of employment 

• Understand the' principles of business operation 

and the cost of doing business 

7. Consumer education instruction provided in your pro-^ 
* gram has helped you: 

^ • Learn to manage time and mdney 

5* • Become a wise shopper 

• Conduct personal business transactions 

• Manage the responsibilities of a job' and home 

• Conserve energy and other natural-resources 

8. Cpunseling and guidance services: 

• Meet your needs and interests 

• Help you plan your program 
Help you make career decisions and choices 

• Are previdecTby knowledgeable, interested staff 

• ' Inform you of hontrad^tional occupational 
opportunities for both sexes 

9. Job success information on former students in your 
occupational program: 

• Is provided to help you make career decisions 

• Indicates how many job opportunities there are 
in your occupation 
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• Identifies where these job opportunities are 

located 

• Tells about job advancement opportunities 

• Explains why former students succeeded or failed 

on the job 

10. Placement services; 

• Help you find employment opportunities 

• Are fair and equal for all students 

• Prepare you to apply for a job 

11. Special services (such as financial aid, tutorial, child 
care) are: 

, Available to meet your needs and interests 

• Staffed with knowledgeable and interested 

personnel . * - 

12. Occupational teachers and aides: 

• Know the subject matter and industry require- 

1 ments 

• Are available to provide help when you need it 

• Provide instruction so it is interesting and under- 

standable / 1 



ERLC 



13. Facilities and equipment for your occupational courses 
are: 

• Safe, fuhctiona and well-maintained 

• In sufficient quantity t& avoid long delays in use 

• Current and representative of industry 

• Available on an equal basis for men and women 

/ '' 

14. Instructional materials (e.g., textbooks, reference 
books) for your occupational courses are: 

• Ayailable and conveniently located for use" as 

needed 

• Currspt and meaningful to the subject 

• Fair and objective and not biased toward 
- "traditional" sex roles 
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CHAPTER TEN 



FOLLOW-UP WITH STUDENTS AND EMPLOYERS 

• This chapter provides a methodology, for gathering data from former 
students and their employers concerning job placement and occupational 
readiness for employment. Five instruments are presented for collecting, 
information. Administrative dates range from immediately after the 
student's .separation to a five-year follow-up.- 

» Goal, and Objectives 

Goal > 

The goal of the student follow-up is to measure the effectiveness of the 
occupational programs and the institution as perceived by former students 
and employers' of former students. 

Objectives 

The "objectives of the student follow-up are as follows: 

1. Provide for valid staff development activities 

2. Identify needed program improvements such as curriculum, resource 
materials, and equipment 

3. - Determine community employment needs and trends 

4. Determine, the adequacy of ancillary services such as guidance, 
counseling and placement 

5. ' Determine realistic job tasks to be performed by former students 

6. Determine job placement statistics-reasons for and number of 
students employed and unemployed, number employed part-time, and 
number employed in or out of the. occupational -field for which they 

-were prepared 

7. Determine job retention rates, career mobility, and salaries of 
students who did enter the occupational field . . , 

8 Involve business and industrial employers and workers in the 
planning . and operation of the occupational program 

9. Identify reasons for early withdrawals from occupationa.l programs. 
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10. Identify strengths and weaknesses of the performance of graduates 
as compared with those trained on the job 

11. Determine number of students who plan to continue their formal 
education and in wha^areas* of study 

12. Establish a statistical data base for student 'follow-up information 
that will allow for comparative analysis ' . 

13. Provide a data base for comparing student training costs from year 
to year, from program to program,, and for making budgetary plans 
and allocations. 



Procedures for Administration 



Selecting the Institutional Representative 

Prior to the commencement of any evaluation -"activities, the institution 
should designate an institional representative to be in charge of 
administration of this component. It is recommended that this institutional 
representative be an administrator or supervisor, be familiar with and 
engaged in the day-to-day operation of the occupational programs and 
services, and be able to devote appropriate amounts of time to these 
responsibilities. ^ 

If the institution has a job placement specialist, this person will be 
involved in the student follow-up activities. The institutional 
representative must work closely with the job placement specialist in 
organizing and conducting this aspect of the total evaluation. 



Launching the Follow-up 

A good starting point might be to assess what has been done in recent 
years regarding student follow-up within your institution. Review what 
other schools have done. Review the sample documents contained in this 
document, and collect other instruments that might be adapted to the needs 
of your institution. 

Involving Staff and Faculty 

Experience has shown that total staff and faculty Involvement in a 
follow-up survey is most effective. It is suggested that near the beginning 
of the follow-up process an orientation meeting be held to get acceptance, of 
and commitment to the follow-up. Also, launching follow-up programs in an 
open and receptive atmosphere will .help to dispel misconceptions, avoid 
pitfalls, and ensure a successful program. During the orientation meeting 
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it is important to spotlight successes* and to help edfeh person see the 
potential benefit of their efforts. 

t . v. 

Identifying Components of a Follow-up Study ^ 

Federal, stste^ and/or local legislation will dictate many approaches to 
a follow-up study. Therefore, it is suggested that legislative Bets 
concerning fol low-Op. be reviewed to ensure compliance with specified 
requirements. However, before a follow-up progranr can be conducted 
decisions must be made conperning the following: 

Preparing for the Follow-up h - 

1. Determine what you want from a follow-up study. Determine your 
•objectives. 

2. Select, modify, and adapt instruments to fit individual school 
needs. Appoint a faculty-administrative committee to review 
instruments and make recommendations. / 

3. Adapt cover letters to meet specific needs. • 



4. Determine how each instrument tyiTl be administered—mail i telephone, 
or personal visit.., 

5. ~ Determine what method of dupl ication will be used. Determine 

quantities needed. 

6. Determine- the scope of the survey, Af this has not already been 
determined. P ' 

Do you want to follo^r-up students who graduated during the Itfst. . 
year, the la£t three*years, or the last five years? 

% J Will a random sample suffice, or dp you plan total cdyerage? If 
1 random sampling techniques are used, determine' method. 

7. Prepare tentative schedules for conducting the follow-up. 

8. Designate individual responsibilities, if total staff and faculty 
involvement is to be used* 

9. ^0£>tain names addresses , and telephone numbers of those to be 

surveyed (including employers). This could be a total staff effort 
tar one person could be designated to fcollect and brganize %he data. 
The school records office should be used in this task. 
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10." Select and prepare an appropriate coding system for recording 
information. ' 

Conducting tfte Follow-up • 

1. Conduct survey--mail instruments , make telephone calls or. personal 
visits. , 

2. Taljy responses as returned questionnaires arrive. (RSfer to tally 
^instruments and composite reports.) 

\ ' 3. Make schedule for follow-up request. to non respondents.- Two weeks 
after the requested return date a second" attempt should be made to 
obtain a response. This can be accomplished by mailing a reminder 
letter (Sample Document 2) along with another instrument or by 
telephoning those who have not completed. 

4. Mail second instruments to non respondents or begin interviewing. 

Procedures for Data Analysis 

— : — V ^ . . • 

Tally Instructions 

Once a satsifactory portion of instrument 'responses has been received, 
the results ar.e ready for posting on the -"Tally Instruments and Composite 
Reports." The responses may be tallied manually or a computer could be 
utilized for .summarization. 

1. If a small survey is being conducted, involving less than one - 
hundred individuals, a hand tally of the results is probably the 

* most efficient means of summarization. 

2. However, if a much larger survey is being conducted, you may. wish to 
use a computer to summarize your results. Of course, the 
availability of a computer or other data processing facilities r 
will influence this decision. 

, ■* 

3. After the responses have been tallied, the totals provide a 

composite report. 



Composite Report . * . 

The totals of the tally instruments comprise- the composite reports. 
These composite statistics could be transferred to a duplicated copy of the 
original survey instrument if the tally instruments and composite reports 
appear to be crowded or cluttered* 
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'The "Tally Instruments and* Composite Reports 1 ' include two 
classifications of data: 



' Data- collected from follow-up instruments 
Institutional extant data (Former Student Program - m 
Eval uation) j ^ 

* The extant data should be available in the permanent school records, 
placement office, departmental offices, instructors, and from other sources 
that maintain school records. The foTlow-up data will be collected as the 
responses are recorded. .The "Tally Instrument'and Composite Reports" must 
preserve the- anonymity of individual responses and only show group dat£. 

The data needed by different institutions will vary* However, the 
following examples are types of information that rtitght be included in the 
composite report: ' f 4 



Follow-Up Report (From- to Date) ♦ 

Extant Data: , , . * 

Total Enrollment . \ 

Completions - 
Returning Next Quarter 
Withdrawals 

Data collected from Follow-up stujly:, 

Completions v 

Continuing Education • 

Employed in the field 

Employed in unrelated field 

Unemployed . ' 

Entered military service , 

Unknown 

* . Employed in service area 

Salary information \ ■ * 
Students and Employer perceptions of occupational 

op* training .programs 

^mudents and. Employers visited. 
Employer and Student comments and recommendations 

Responsibilities of Institutional personnel 

1. It is suggested that the institutional representative finalize the 
data into understandable information, duplicate, and distribute 
copies of summaries to program instructional staff. Response 
summaries can be presented .in the form of tallies, percentages, , 
histograms, or averages. The method most applicable to presenting 
and interpreting the specific data should be utilized. The report 
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should begin with a statement of how the" daf.d here collected and for 
*what purposes. . , . • 



2. The institutional representative forwards the inriepth data to the 
proper department chairperson and the support services, supervisor. 

3* Summary conferences are cpnducted betweep the department chairperson 
and the program staff to review an<£ discuss the program data 
gathered. Also, the support services supervisor holds a summary, 
. conference to review the institutional data gathered, 

x * 4. The department chairperson records those identified program needs 
; on the program needs analysis profiles, and tfie support services 

supervisor records those identified institutional rveecls on the 
• ' ^ institutional needsymalysis profiles* 

Data Utilization 

Jlhe primary purposes of this total evaluation model is for individual, 
program* and institutional improvement. In order for the data gained from 
% the. process in this manual to be meaningful, it must be utilised. It is 
^extremely important that all concerned parfies be informed of the results 
'and trie implications for impfr)vemerit\ The Student, Follow-Up Flow Chart* on 

/jthe following p^ge provides an overview cf the process covered in tKis 
chapter, « „ ( 
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STUDENT FOLLOW-UP 
Flow Chart 
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^ * Listing of Sample Docum&nts ' * 

Number of Dq&jmept .Document- Title 

1 % Sample Cover Letter to Accompany Student 

Fol low-Up Forms as Fol 1 ows : r~Early 
Leavers, Program Completers, and Former 
Students 



• . Sample. Cover Letter to Accompany Second* 
■ " Attempts for Follow-Up Forms, as Follows: 
Early Leavers, Program Completers, and 
Former Students 

3 Sample Cover Letter to Accompany Follow-Up*^ 

v Fonm Former Student Program Evaluation , 
^Three-and/br Five- Year Follow-Up 

.4 Sample Cover Letter to. Accompany Fol low-Up 



Forms: Former Student Program Evaluation 
Three-and/or, Five- Year Fol low-Up 



5 * Student Fol low-Up: Early Leavers Form 

- * . Student Fol low-Up Tally Instrument and 

Composite Repeat: Early Leavers Form 

7 Student Follow-Up: Program Completers Form 

8 Student FoNow-Up: TalJy Instrument and 

Composite Report 

Program Completers Form 

v %^ „ 

9 1 • ' ~ Student Fol Tow-Up: Former Student Program 

£val uation ■ 

1 

* • ~10 .Student Follow-Up: Tally Instrument and 

* ■ . Composite Report Farmer Student Program 
• - Evaluation ^ 

1 Student Follow-Up: Employer's Evaluation of 

Former Stud§nt$ , - 

12 Student Follofo-Up:^ Tal ly -Instrument and 

p . Composite Report 

* * / Employer's Lval uation" of Former Student 

h 13 ' Student Follow-Up: Three-and/or Five-Ye^r 

- ^Follow-Up 
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Student Follow-Up: Tally Instrument and 
Composite Report % 
Three-and/or Five- Year Follow-Up 

Additional Methodology for Gather^ig Data 
Related to Employer Perceptions 
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Sample Document 1 



SAMPLE COVER tE T TER TO ACCOMPANY .STUDENT FOLLOW-UP 
FORMS AS* FOLLOWS: EARLY LEAVERS, PROGRAM 
. COMPLETERS, AMD FORMER STUDENTS 



Dear Miss Doe: ' ^ 

You, as a former student of ( Nami- of Institution) - 

are one of our most valuable sources for suggestions on how to improve 
our occupational programs. Please help us, to better serve students 
and the community by completing and returning the enclosed form by 

( Return Date) . • A stamped, addressed envelope is 

enclosed for your convenience . 

If you desire to-. sign your nenne, a place is provided. If you wish for 
your responses to be anonymous, do not complete the name and address 
section of the-form. All information you supply will be held in con- 
fidence, and your name will never be associated with any response. 

Your cogperatibn in this improvement effort will be appreciated. 
Cordially, - * v 



John H. Smith - 

Job Placement Specialist 4 
JHS:ije 

Enclosure 1 > 
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Sample Document 2 



SAMPLE COVER LETTER TO ACCOMPANY SECOND ATTEMPTS, FOR 
FOLLOW-UP FORMS AS FOLLOWS : s EARLY LEAVERS, 
PROGRAM COMPLETERS, AND FORMER STUDENTS 



Dear Mr. Smith: 



(Name of Program) 



HELP! We Vieed your evaluation of the 
occupational training program at 

Without your perceptions, as a former studen'tythfc foHow-up-iTifo'rmation 
will' not be. complete. We have been waiting to' hear from yQtrT 



CName of 'Institution) 



In, case you did not receive our first letter, this second copy of the 
follow-up form is being sent so you will have the opportunity to let 
us know how you feel about the training you received. « • 

Won't you as an alumnus of (Ngpie of Institution) 

help us improve the occupational training for future students. Please 
mail your completed evaluation form, today. A stamped, addressed envelope 
is enclosed for your convenience, let its assure you that all responses 
will be helct in strict confidence. 

' < - \ ' , . ' 

Your cooperation is needed and will b.e appreciated. 

Cordially, 



John H. Smith 

Job Placement Specialist 

JHS:ije 4 

'Enclosure * 
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Sample Document 3 



SAMPLE COVER LETTER TO ACCOMPANY FOLLOW-UP FORM EMPLOYER'S 
EVALUATION, OF FORMER STUDENJS - 



Dear Mr. Doe: 

Your help Is requested! We are currently conducti ng v a study to evaluate the 
effectiveness of the (Name of P rogram) ^ 

program offered to 



(Na&c of Institution) h 

an employer of fo.'iner students, your, opinions are valuable. 



students. As- 



A short evaluation form, is enclosed, which can be^completed in a very few 
minutes. .Will you please take a few minutes to Complete ttfis form' and help 
us in our efforts to better serve student^ ^nd the community.. No employer, 
employee, or supervisor will be identified in the results of this study, and 
all respor^es will be kept ifi complete confidence. 

Your answers will help us to identify the strengths and weaknesses of our„ 
present occupational training programs. You will be making a valuable^ 
contribution to the improvement of the training of future students. Please 

complete and return the forms by (Return 'Pate) . A stamped, . 

addressed envelope is enclose'd for, your convenience, 

Your'lcooperatton will be appreciated.* ■ * 

CoVd tally, . ■ * * 



John H. Smith 

Job Placement , Special rst 



JHS/ije 
£rv?losur;e 



/ . 
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Sample Document 4 



SAMPLE LETTER TO ACCOMPAN-Y FOLLOW-UP FORM: FORMER STUDENT 
, PROGRAM EVACUATION THREE-AND/OR FIVE-YEAR FOLLOW-UP 



• - 

Dear Miss Jones: ^ 

"There is no substitute for experience" is a welUknown cliche. Your 
, experience on the job could be very valuable in helping to improve $nd 

update 'the occupational offerings at (Name of Institution) . 

Your insight into current' occupational training programs offered at 

• (Name of Institution) ; are 

reque-sted. / 

As an dlumnifs of this Institution, please take a few minutes and complete 
--.and return the enclosed form. Your responses are needed b y (Beturn Date) 



A stamped" and |ddressed envelope is enclosed for your convenience. 

All - -information you supply will 'be held in confidence, and your name will 
never be associated with any response* If you desire to sign your name, a 
place is provided. If you wish for your response to remain^ anonymous, do 
not complete the name and address section of tyie form. 

* v * 
Your cooperation in this improvement will be appreciated. 

Cordially, " * 



John H. Smith 

Job Placement Specialist * 
'jHS/me • ■ 
Enclosure 
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• ' •' Sample Document 5 

- . • ; 

/ • . 1 ... 

~- l • ., < , 

< . STUDENT FOLLOW-UP: , / 

V 

. • ' . EARLY ^LEAVERS FORM 

This form requests the following information from students who J eft the 
program before completion ,emd their status is unknown. 

a; Reason for discontinuing studies, 

b. Present status ^nd. employment information 

•"" c\ Suggestions for improving ✓pfogram and institutional services 

J d. Future plans - 

It js Suggested that this instrument be mailed to each student's last known 
address immediately, upon his/her withdrawal from school-. 

A cover letter (-Sample Document 2) accompanies this instrument. 



V , 
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STUDENT F'OLLOW-UP 



V earlV Leavers form 

_> 

YftllR RESPONSES TO THESE QUESTIONS WLLL BE TREATED AS CONFIDENTIAL INFORMATION, 
' K ANSWERS WILL ONLY BE PART OF A. COMPOSITE REPORT IN WHICH INDIVIDUAL 
.RELIES ARE NOT IDENTIFIED. YOU MAY LEAVE BLANK ANY QUESTIONS YOU. DESIRE/ NOT 

TO ANSWER . 



Name 

Address 



Program • \ . , — — 

I- Please check the reason for discontinuing your studies at this institution 
prior to completing Xhe prescribed course of study: 

Employment ' - , 

1_1 Home/ family needs 

Military ' . 

Financial 

course of study was not suited to my* interests. 

My course of study was not what I'd hoped it would be. 

* ~ Other,, (specify) : . — ■ — ■ - 

2. Check your present employment status:' 

_._.Part Time • > . /Full Time , , \ Unemployed 

3 If unemployed or employedVpart time, please check the reason why: 
Part' time employmlrrt is all I desire. • .* 
'4 do not want a job. . 
' V I'm in the military service 

",1'm in school . , ' 

■ " Khave not been able to get a job. ... ■ . 

' I do not have enough, training. 

*T- I dislike the work-. for which I was trained. 

-'— i cari 't. earn enough money to make it worth working. 

Other, (specify) . _ \ a - '■=■ • ■ 

4. Employer , f , : : ; " 

Employer's address ' l_ \ . '■ ■' 

Position title ^ _____ : , — ■ — 

Nature of work ; , __ ; < — 

Is your job related to the .instruction you received at this institution? 

. , : Yes • . . No . 

Who helped you get your job? - 

Parent _____ State EmP 10 )^ 1 - 11 * Bureau 

--- Friend _ Private Employment Agency 

, Instructor ' Other (specify) 

. " Job Placement 
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Student Follow-up 



' Paye 2 



5. Suggestions for improving instructional/occupational training, 



T 



6. Suggestions for improving student services (Admissions, Job Placement, 
Counseling, etc. ) 



7. Do you plan to continue your formal education? 

Yes • _ ) 

-If yes, in what area? 



- # 



« * 
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Sample Document 6 
/ % STUDENT FOLLOW-UP TALLY INSTRUMENT AND COMPOSITE REPORT 

" /EARLY LEAVERS FORM * " * 



The Early Leavers Form was mailed to : 

by_ ;_y a l _ percent* response. 

Program v * 



former students and returned 
Year 



1. Reason for discontinuing studies at this institution prior to completing 
the.orescribed course- f * - 





1 

< Employment j 


Hbme/Fami ly 
Needs 


ro 
+-> 
•r~* 
r— * 

*TT m 


Financial 


Course of 
study not 
suited to 
my interests 


Course of 
study not 
what I'd 
f hoped i t 
would, be 


Other 
(specify) 

T' 

1 










* 




































* r" 




T ■: i' 

















2. Employment Status 
y Part-time 



EuU-time 





Unempl oyed 




ERIC 
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» 



3. . Reasons for part-time and unemployment: 



• 


Part-time, 
is all . 
desired 


Do not 
want a 
job 


In 

Military 
r Service 


In 

Q r+ r\ r\ r\ 1 

ocnoo i 


Not a We 
to get 
a- jcB ■ - 


Not 

enough 
training 


*Dislike 

^he 

work 


Can't 

earn 

enough 




► Other 

(specify 
on sheet') 




s 








IB 




















*• 










4* 




Total 





















4. Is the job related to occupational instruction* received? 



CD 
O 



YES 



Ho 



Total 




Total 



5. Area of Employmer^: (taken from employer's address) 



■EMC 
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r 1 ; 
\ 

i i ' 

L . ; 

1 

i 




- «*; ■ 1 


* 




■ ( 





• Geographic Locations 
in the State In State Out of State 
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Student* Follow -Up Tally Instrument and Composite Report 
Early Leaders Form , # 

6. Who. helped former student get' job? 



Page 3 





Parent 


Frienci * 


Instructor 1 


Job 

Pla'cement 


State 

Employment 
Bureau 


4-> 
C 

CP O U 
> i— c 

•r- Q. OJ 
• CL LU < 


O 
















x ' 


























> 








% 






> 












i f 














/ 












\ 










i 














t x 












# 


> 




\ 























•7! Former studervts who plan^to continue their formal education: 




In what areas: 



Total 



'8-. Suggestions for improving instructional/occupational training: 



' 181 
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Student Follow-Up Tally Instrument and Composite 'Report 
Early Leavers Form 



Page 4 



9\ Suggest! pits for improving services: 



\ 



182 

• 194 
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Sample Document 7 



STUDENT FOLLOW-UP: 



PROGRAM COMPLETERS FORM 



This form is mailed each quarter to, students who completed (were placed on a 
job) the previous quarter. < 



The purpose of this follow-up is to gather information concerning the job 
salary, and entry-level tasks of the occupational field. The student's 
perceptions of the instructional program and ancillary services are gathered 
about a year* after job placement— after the student has had sufficient 
experience to make valid suggestions concerning his/her readiness for 
employment. ^ 

Similar information is requested from students of each program. However, 
the forms request the following 'specific information pertaining to the « 
program: ^* \ 



b. Student perceptipns concerning the'scho'ol including 
recommendations for ' improving the program and in- - 
stitution 

c. Future plans 

A cover letter accompanies thijs instrument (Sample Document 1).* 



a. 




4 



i 
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STUDENT FOLLOW-UP 

Prpgram Completers Form 

YOUR RESPONSES TO THESE QUESTIONS WILL BE TREATED AS CONFIDENTIAL INFORMATION. 
YOUR ANSWERS WILL ONLY BE PART OF A COMPOSITE .REPORT IN WHICH INDIVIDUAL REPLIES 
ARE NOT IDENTIFIED. YOU MAY LEAVE BLANK ANY QUESTIONS YOU DESIRE NOT TO ANSWER. 

* • 

Name s ^ i 

Address 



Program _ 

1, Please .check your present employment" status: : 

Full-time \ Part-time Unemployed 

If unemployed or employed part-tifiie, please check the reason why: 

Part-time employment is all I desire, 

Trn in the military service. » 

I'm in school , 

I have not been able to get a job. 

I do not have enough training. 

I dislike the work for which I was trained. 

I do not want a job. 

J I can't earn enough npney to make it worth working, 

' Other, (specify) J p 



Employer 

Employer's address 



How long have you been on your present job? 

' 1 - 2 months 3-4 months" .* 

2-3 Months . 4 - 5 months . 

y , ~ more than 6 months 

3. Is your job related to the training you received at this institution? i 
Yes No . x 1 

4. Approximate weekly salary, before deductions? 

• z_ Under $100 • $176 to $200 

$101 to $125 - $201 to $250 . 

$126 to $150 '$25i or more- 

$151 to $175 " «. 

* 

If you were employed prior to attending this institution, wbat was your 
approximate weekly salary, before deductions? 

• Under $100 _ $176 to $200 

. $101 to $12.5 ' 1 $201 to $250 

$151 to $175 m " $251 or more 

5. As a whole, how do you feel about your experience at^this institution? 
'Like it^very much ' 

Like it pretty well 

Neithfer like nor dislike it 

Dislike it niore than like it \ 

r Dislike it very much \ 

' \ • ' 
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^Student Follow -Up Program Completers Form 



Page 2 . 



6. Please make any cofnment that you feel would aid Us in improving the 
school or the program you took. * 



7. Suggestions for improving student services (Admissions, Job Placement, 
Counseling, etc.) at this institution. 



8. Do you plan to continue your formal education? 
'_J Yes No 

If yes, in "wha~r "occupational 'area? 



aa5 



9 
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' STUDENT FOLLOW-UP: TALLY INSTRUMENT AND' COMPOSITE REPORT 

Program Completers Form 



PROGRAM 



(EXAIfPLE) Business Education 



YEAR 



1Z77 



The Program- Completers Form was mailed to ' 23 former students and returned by 
a 5T percent response, 



12 



.Present employment status-? . 
Pa^^time * 

I * ' * 

r 



Full-time' 



■ Unemployed 



2. .Location of employment: 



Service Area 



Your Institution 



3. Reasons' for unemployment arid part-time employment: 



Your State . ' 



Out of State 



J 



198 



1 - 
Part-time 
is all I 
desire 


Do not 
want a 
job 


In j In 
Military j School 
Service 


Not able 
to-get a 
lob . 


•Not 
enough 
training 


Dislike 
' the 
work • 


Can't 

earn 

enough 


Other f 
("specify ■; 
on sheet) j 


s 




i 
| 

i — j — 


— — 


* 


* 


• 


.i 

• 

t 

i 






. i 
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Student Follow-Up Tally instrument and Composite Report 
Program Completers Form 

4'. Length of time on present job: 



Page 2 

( 



Less* 
than 
one ' 
month 


' months 


2 - 3. - 
months 


3-4 
months 


_4 - '5 
months" 


6 ■ 

months 
or 

more 




» 


* 


4 














* 





5. Is job related to training received at this . institution? 



YES 




NO 



Total 




Total 



6. Salary information: 



9 
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>- 

< 

'< 

CO LU 
I — 

I — <c 

LxJ 

a: , 
cc 

B 



Total 



a: to 
o 

nz 
c£ i — 

CL 

o 
i — >— < o 

cr: -2: i — 

LU ZD 
>- I — I — 
CC J i 

< <ar h- 
_J CO 

< o z: 

CO f— * 



Total 



<G) O 
T? O 

C f-H 

Z3 -CO 



i-H LO 

O CM 

f-H O f-H 

CO 4-> CO 



CO O 

cm cn 

i-H O fH 

C/> 4-> CO- 



f-H O fH 

•CO- 4->«CO 



KO O 

o 

f-H o CM 
CO 4-> -CO 



f-H O 

O LO 
CM O CM 



UO 
CM 
CO 



s- o 

O B 
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Student Follow-Up Tally Instrument and Composite Keport 
Program Completers Form 



Page 3* 



7. Feelings about this institution 



* 

> 


LikSd it 


Liked it 


Neitmer 


Disliked 


Disliked 




very mych 


pretty well 


liked nor 


more than 


it very 








di si iked 


l"ilte(t - 


fliuch 




i 














- 




\ 

0 






V 










total ' 


* 1 











8. Former ^tudejits who plan to continue their formal education: 

In what areas: 




L 



Real Estate 



r 

1ST 



Total 



9. Suggestions for improvement: 

Moy'u tvainintj cm Co U phone Le.eh>iu{UQS needed. 
/] quiet study area needed. 
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Sample Document 9 



' STUDENT P-OLLOW-UP I 

• » * • 

' * ' FORMER STUDENT PROGRAM EVALUATION 

It is suggested that the information requested on this form be obtained by • 
an on-site visit by a school representative, the job placement and follow-up 
specialist, or institutional representative. If, a personal visit is not 
possible, the form is designed for gathering the information by mail or 
telephone. This information is gathered one year after the student was 
• employed. The student has had time to gain experience on the job and review 
the instructional program in light 4 of empJoymer\t needs. The instrument 
gathers dat^concerning the following; 

^ a. Present status and employment information 

b. Student' perceptions and recommendations concerning., 
the occupational training program including equips % 
ment and resource materials 

> c. Instructional methods 

The 7 cover letter shown (Sample Document 1) is intended for use only if the 
instrument is mailed. 



4, 



Mi 















V'' 










H, f 



/ 
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STUDENT FOLLOW-UP: 



BUSINESS* EDUCATION 



. F.ORHER STUDENT PROGRAM EVALUATION . ' 

YOUR RESPONSES TO THESE .QUESTIONS WItL BE TREATED AS 
CONFIDENTIAL INFORMATION. YOUR ANSWERS WILL ONLY BE . . 
A PART OF A COMPOSITE REPORT -IN WHICH INDIVIDUAL REPLIES 
ARE NOT IDENTIFIED. 'YOU MAY LEAVE BLANK ANY QUESTIONS YOU 
DESiRE NOT TO ANSWER. 



Name 



Address 
Program 
1. 



Please indicate your present status. 

Employed / Unemployed (If unemployed, skip to 

number 7) 



2. 
3. 



Employer 

Employer 1 s address 

Job Title* = 

Job Duties 



Is your job related to your occupational, training at the institution? 

' Yes . . ^ ^_ No \ 

> 



10 - 12 months 
over 12 months *. 



5. Length of time on the job* 

1-3 months 

'I ~ '4 - 6 months ' 

\ 7-9 months 

6. ' Have you received -any promotions since^ going to work? 

7. Please rate each area of training you had. 



Typewriting 

Shorthand 

Filing 

Office Procedures 

Business Math 

Duplicating Procedures 
Verbal Communication 

Wr ?Men S Commun i£a t i on 

Skills 
Accounting 

Telephone Techniques 
Business Machines 
Human" Relations 



Need F'urthef 



Students Rating of Training 



Yes 


. No 


Excel lent 


Good 


Fa i r 


Poor 




/ 


















4- — 
























4 ' 








• T '" ' — — 













1 
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Student follow-Up Former Student Program Evaluation 



,Page 2 



8. 



In general, how much help was your occupational training in the 
following areas: 



Knowing how to, use tools and 
equipment % . 



Knowing what one' does in this 
•kind of job • . . . 



Using time and energy productively. 

/Finding 'needed job related 

information. . * . 



Being able to talk to the 

supervisor about job problems. 

Getting along with the customer, 
being patient and so on. . . . 

-Getting along With other workers-. 

Interviewing for a job 

Handling new or unpleasant 

situations 



Applying for a job . : [ 



MUCH' 


SOME, 


LITTLE 


NONE 




















• 










v 
















- 




A 



































Please mark the following instructional methods in terms of how you. 
learn the best. 



• Lecture %» 

Individualized instruction . 

Group activities 

Project activities . . . . £ 
.Demonstrations . • 

Homework 

Programmed texts 

Reading 



Life 


. DISLIKE- 


DON' T 
KNOW 


























-fl 

























10. Was the equipment used in your 'training program consistent with what 
you have used on the job? % \ 

Yes No (Please explain "No" answers on comments section) 

11. Please rate the resource materials' (books, audioyisuals', related magazines, 
etc.), available to you as a student in your occupational training program. 

Excellent Good I Fair Poor 

fPfease explain "Fair" and "Poor" ratings under comments section.) 

12.1 Comments and suggestion^ for 'improvement: 



9 
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Sartiple Document 10 



; STUDENT FOLLOW -UP TALLY INSTRUMENT AND COMPOSITE REPORT 

Former Student Program Evaluation 

' The Former Student Program Evaluation form was mailed to -former 

students' and returned by , a percent response. 



Program ^ 



Year 



E mploye d 



* Ujiemp]oyed_ 



Total 



Tefal " 4 



2. Is the job related to the occupational Instruction received? 



Yes 




Total 



3. Location of employment : - 



No 



Of 



Total 



' t 



Service Area 



Your 

Institution 




Total 



Total 



Your State 



Total 



.Out of State 
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Student Follow-Up Tally Instrument and Composite Report 
Former Student Program Evaluation j * 

4- f l ength of time on present job: 



• Page 2 





— 




• 
















CO 


to 






r-H CO * 


CO 








CVJ -C 


\o sz 




sz 


-C 


.c 








{ > 








• 1 4-> 






> 
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c ' * 


c 
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o E 
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5. Former Students receiving promotions since going to work: 




Total 



6. Instructional methods in terms of how the students learn the best: 



LIKE 



! Lecture 



Individualized instruction 




Project activities 
Demonstrations 



Homework 



Total 



DISLIKE 



Total 



DON'T KNOW 



Total 



Total 



Total 



Total 



Total 



Programmed texts 



er|c 



Reading 



Total 



Total 



Total 



Total 



Total 



Total 



Total 



Total 



Total 



Total 



Total 



Total 



Total 



Total 



Total 



1 



Total 



Total 
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7* Students rating of training at your institution. 
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Typewriting . 

Shorthand 

Filing ! 

Office Procedure^ - 

Business Math 9 

Duplicating Procedures. . K . . 

L 

Verbal* Communication Skills . 
Written Communication Skills; 

Accounting ' . 

Tglep&e«e Techniques 

Business Machines 

Human Relations 



Need°Further Training 


Students. Rating of Training » 


Yes 


No 


Excellent 


Good 


FaiA 


Poor 


Tctal 


Total | 


Total 






Total j 












1 






r 


r 






r 


r 




r~ 


r~ 

i 


j 
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8. In general, how much heTp was occupational training in the 'following areas 



Knowing how to use tools 
and equipment ' 

Know what one does in this 
kind of job 



Using time and energy ; 
productively ' 



Finding needed job related 
information , Tjtal 

Being able to talk to the 
supervisor about. - f 7 
job problems ^ 1 -' za - 

Getting along with the 

' customer* being patient 
and so on Total 

Getting along with other 

workers Total 



Interviewing for the 

job total 

Handling neto or unpleasant 
situations 

. Total 



Applying for a job 



Total 



j MUCH -- 


SOME 


LITTLE 


NONE 


j (EXAMPLE) 

* 

1 

i ... . 




• 


• 


t 
t 










i 

i 
t 








i 

i 

1 : 




- - 




j 

1 




• 




1 
1 








1 — 

1 


J 






























• 


• 










T 1 










1 






















j> * 






* 




* 












■ 






* 




J ■ 
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Si. 
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Student Follow-Up Tally Instrument and Composite Report 
Former Student Program Evaluation 



Rage 5 



9. Was the equipment. used in the training program consistent with what 
former student uses on the job? - * « 




Total 




Total 



10. Former Students rating of resource materials used in occupational 
training program. r ^ * 




Total 



Total 




11. Comments and suggestions for improvemehts. 



4 > 
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Student Follow-Up TaOly rnstrunfent and Composite Report. Page § 

Former Student Prpgram Evaluation < * 

#* 

Program Ext ant Data . •< 

r^-i — • * 4 

Program - : •. ; Year 



Number 1 Percentate 



Total Enrollment - 1 ' 

.Completions l * - 

Returning next quarter " v 

Withdrawals . 

The extant data shown above are factors to be included inmost analysis. 

The following formulas for computing cost per -placement and cost per 

student are given as examples: ' 

* • * 

♦Cost per Student •♦Cost, per Placement 



*C0ST FACTORS *C0ST FACTORS 

*T0TAL ENROLLMENT ♦♦.♦STUDENTS PLACED IN FIELD 



♦The following cost factors were used .by the developer institution: : 

--Total salaries for instructors 

--101 Equipment (15 percent of total cost to 

be depreciated over a 7-year period)^*- 
--100 percent of lease equipment and maintenance 
--Supply expenditures - , •■«•••--. 

-**Total Enrollment includes completions, returning next quarter, and 
withdrawals. , ' « 

♦♦♦Students placed in field is the total taken from question 2 of this 
^ composite report. ' . 
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" STUDENT FOLUQW-UP 
EMPLOYER'S EVALUATION OF FORMER STUDENTS 



The information requested on this form is obtained after the farmer student 
has had time to get familiar with the job and the employer has had time to 
observe and evaluate the employee's performance. The institution gets this 
data approximately six months to one year after the former student is 
employed. , ✓ 

It is suggested that this information be obtained by an on-site visit V the 
job placement specialist or the institutional, represeRtati ve. However, if 
such a visit is not possible, the information could be obtained by mail or 
telephone. 



J 



The instrument collects the following data': 

a. Employer or business information 

» 

b. Performance ratings in specific skill areas as well 
• as those in the effective domain 

c. Comparison of a former student 's performance with 
.that of an employee* Who was trained on the job or 

\ was trained in another program 

d. ' Suggestions for improvements in occupational 

training program. ] . • m 

The cq^er letter shown* (Sample Document 3) ^s intended for use only if the 
instrument is mailed. 



4 
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■ STUDENT FOLLOW-UP. , : 

s . 

Employer Evaluation of .Hornier Students 

YOUR RESPONSES TO THESE QUESTIONS WILL BE TREATED AS CONFIDENTIAL INFORMATION. 
YOUR ANSWERS WILL ONLY BE PART OF ACOMPOSITE REPORT IN WHICH INDIVIDUAL - 
REPLI ES ARE NOT I DENTI FI ED/ YOU* MAY LEAVE BLANK ANY QUESTIONS YOU DESIRE NOT 
TO ANSWER. 



Employee 

Emp Toye^" ( _._ 

Employer's address 

Employer's telephone 

Name of Supervisor 

Jot? Duties performed-by employee 



1. 



2: 



over 18 months 



Length of time employee has been on the j/)b: 

- 6-8 months . 12-14 months 

9-11'months 15-18 months 

Please rate -each of the general traits of the employee listed below 



General trait 


Excellent 


Good 


Fair 


Poor 


"INTEGRITY: Trustworthiness, honesty, 
and loyalty 










DEPENDABILITY: Promptness and 
reliability in attendance 










RESPONSIBILITY: Willingness with 
which work is accepted and performed 










INITIATIVE: Ability to plan and 
direct own work 




• 






JUDGMENT: Ability to make sound 
decisions - 










COOPERATION: Ability to work in 
harmony with others^^ 










LEADERSHIP: Qualifies of under- 
standing people ajid directing others 










ATTITUDES TOWARD WORK: Degree of 
enthusiasm with which one performs 
work * 










EMOTIONAL STABILITY: Koise and self- 
control 










"COURTESY AND FRIENDLINESS-: Shows 
genuine consideration and kindness 
toward others 










PERSONAL APPEARANCE: Neatness 
cleanliness, appropriate dress, 
and grooming 
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Student Follow -Up Employer Evaluation of. Former Students 



3. Please check "Yes", or "No" .on need for additional training ana! rate 
employee's Performa/ice in each skilled category. ' 



Pvamnlo * Rut l nocc CfUtrat'inn 
.LAdllipit:. DUolllcob LjAULa \ I y M 


1 - Needs 
Addi tional 
« Traininq 


Employee's Performance in' 
each skilled area ^, 


lypewn ti rig 


YES NO 


Excel- 
lent 


I Good 


J Fair 




,i — 










b hart nana 













Filing 




Office Precedures 




— - — — 


< * 


— — 


' r 




business nam 










Duplicating Procedures 


_ — 


/ — 








verDa 1 Lornrnuni cation jki us 













Written Communication Skills 


^ — : — 






h • 




Accounting 








— t — 

V 




Telephone Techniques 






t e 




*** 


Business Machines 












Human Relations 




— _ — ^ 








Overall Rating of Skills 




t-- % 


H ' 
at^ ■ 





4. Please compare the performance of thi^ employee wfth the J^^orm£^e 4 of 
an .employee who was trained on the job. 



Performance of employee trained at this institution. 

Superior 

■ Better 

_J Comparable to but no better tfian 

P« 



er 



5, Suggestions for improvements in or updating of this particular 
occupational training program: , t 
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Sample Document 12- 



^ Program 



Ml 



STUDENT FOLLOW-UP TALLY INSTRUMENT AND COMPOSITE REPORT 

4 . 



Employer Evaluation of Foywr fKidents 



Buciness Education 



9 



Year 



1. Is jbb«^e1ated to occupational training at this institution? 
(Taken fronf^job dufefos)' «? :fa 

YES ** no; 



fe-V 



- 



77>fraZ 



*, 2. Lengtf] of time employee has been. on present job. 



'4l 



Trtal r 



CO C 

I O 




AS 



c 
o 
e 



to 
^ x: 

I C 

C\) o 
^ E 



to 

r-f 4-> 
I C 

o 

^ E 



to 

> ^ O 

o e* 
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3. Please rate each of the general traits of the employee listed belo*w: 



21V 



General trait 



INTEGRITY : Trustworthiness , 
honesty ^nd loyalty 



DEPENDABILITY: Promptness and' 
^reliability in attendance 



RESPONSIBILITY : Willingness 
with" which work is accepted and 
performed ~ * ~ 



INITIATIVE: Ability to plan and 
direct own work 



I 



JUDGMENT : Ability to make sound 
decisions 



COOPERATION: Ability to work in 
harmony with others 



Excellent 



(EXAMPLE) 

Total 



LEADERSHIP: Qualities- of under- 
standing people and directing 
others 



ATTITUDES TOWARD WORK: Degree, 
of enthusiasm with which one 
performs work 

EMOTIONAL 'STABILITY: Poise and 
self-control" 



COURTESY AND FRIENDLINESS: SKows 
a geniune consideration and 

kindness toward others 

PERSONAL APPEARANCE: Neatness, 
cleanliness, appropriate dress 
and grooming / 



Good 



Total 



fair 



Poor 



Total 



total 



r; 



£18 



: / 2 T Employees Performance in Skilled Area: . 

. _ . 4 



" . SKILLS 


• Needs Additional' 
^Training 


Students Rating of Training 


Yes 


No 


Excellent 


Good . 


fair 


Poor 1 


Typewriting 


Total 1 ' 


Total 




■ * 

Total 




Total 


Total 




* Shorthand 


r 






















Filing 




1 






* 






Office Procedures 










< 






Business Ma t th 


t 






















j 


Duplicating Procedures 

"el ua i uuHtiiun i id u on jk i i rs 

Written Conmunication Skills 










« 
















Accounting 






t 

*■ 

t 


■ 






* 






T ~ - ■ 1 — ^— 19 . 

Telephone Techniques 

— ; " : n *=^£ 






















Business Machines^ t 




* 




/ 








Human Relations 

-4 ! , 














> 

Overall Rating of Skills 

4 

— i , ■ — ■ — - - ' 1 








i 
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Student Follow-Up Tally Instrument ana ujmposlte-Keport- 
Employer Evaluation of Former Students • 



Page 4 



5, Comparison of performance of the institution trained employee with 
on-the-job trained employee: 



Superior 




Total 



Better 




Total 



Comparable to but no better than Poorer 




Total 




Total 



6. Suggestions for improvements ip, or updating of this particular 
occupational training program: 



/ 
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Sample Document 13 



STUDENT FOLLOW-UP: 
THREE-AND/OR FIVE-YEAR FOLLOW-UP 



This form was designed to gather information from program completers who 
have been employed in the occupational field. It is intended to gather 
occupational training needs and salary rather than assess the institution's 
training program. 

It is suggested that this instrument be mailed once each three years for 
a three-year follow-up and once each five years foKa five-year follow-up. 
Ar> appropriate cover letter (Sample Document 4) should "accompany the follow- 
up form. This instrument collects the following follow-up data: 

a. Career patterns and present employment information 

b. Occupational trends and salaries 

c. Reasons for out-of-field employment 
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STUDENI FOLLOW-UP 
THREE AND/OR FIVE YEARS 



YOUR RESPONSES TO- THESE QUESTIONS WILL BE TREATED AS CONFIDENTIAL INFORMATION. 
YOUfe ANSWERS WILL ONLY BE PART OF A COMPOS I-TE' REPORT IN WHICH INDIVIDUAL REPLIES 
ARE hOT IDENTIFIED. YOU MAY LEAVE BLANK ANY QUESTION THAT YOU DESIRE NOT TO 
■ANSWER. 



Name . 



Address [ . 

Program ' ! , ! -. 

1. Are you employed at the same place you began working after completing this 
institution? ( 

Yes j No 

If no, how many times havd you changed jobs? 

-1 3 ^ 5 

2 " 4 more than 5 

If you have changed jobs, indicate reasons for doing so. 

__; Better pay 

Better benefits 

More advancement opportunities 

~ Nearer to home , 

, Personality conflicts 

Employer did not live up to promises' 

Fired 

Better working conditions p 
Other (Specify) 



Have you received any promotions? 

Yes , No 

BEGINNING PRESENT 

$75 to $100 • 4 Under $75 

— $101" to $125 ; $75 to $100 

$126- to- $150 , $101 to $125 

$151 to $175. $126 to $150 

• $176 to $200 " $151 to $175 

$201 to $250 Z $ 176 t0 $20 ° 

$251 or more . $201 to $250 

' $251 or more 



4. Present job title 



Job Duties ; — , , - ■-. 

Are you employed on a job related to the training you had at this 

institution? 

No . 

If no, please check reason. 

.j_ The training was not a good_ choice. I didn't know enough about my 

interests and abilities. J 

I didn't know enough about the kinds of occupations in which I 

might get a job. 

I didn't know what the job was really like. 

• Few jobs available in this field. 

'~~ I -needed more training and couldn't get it. 

I couldn't earn enough money. 

Qth^er (Specify) — 

' - . * 
206 . 
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Student Follow-up Three and/or Five Years . r 2, • J^fLQiL 2 



How do you feel about your job? 

It's awful. 

~ Not what I'd hoped ttf have. 

It's OK* 

I like it. 

I like it very much. 



6. Have. the job requirements changed for the occupation you were trained for 

at this -institution . 

Yes No 

f 

Please make recommendations concerning requirements of your job and 
trends that would affect the occupational curriculum and training 
program. 



7. Other Comments: 
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J.. ;. STUDENT FOLLOW-UP TALLY .INSTRUMENT AND "COMPOSITE REPORT 

* '•* Three and/or" Five Years 

The "Three and/or Five Years 11 * instrument was mailed to ^ former 

students and returned by » a percent response. 



Program 



(EXAMPLE) Business Education 



Year 



1. Is former student employed at the same place' he/she began working after 
completing this vaetitution? 




Total 



If no, how many times has former student changed jobs? 



Total 




Total 


i 


2 


r— 

3 


4 


5 


6 


* 




* 
















/ 








* 






: 






-0 



If former student changed jobs, reasons for doing so: 



Total 



-P 

+-> >> 
<D (0 

co a. 



00 

+-> 

t. -r- 

+-> CD 
+-> C 

CO CO 



I 

c ■*-> t. • 

no C O 

> <D Qu 

n E a. 
<c o 



rO E 
0) O 



fl3 

c 
o 

00 >s*4- 

O) .f- o 

/a. o 



<D +■> +■> a> 

>>0 A3 ^ 
O C JC -r- 

— 2 E 

ClX> O 
l E -r- O 

LU X> X> Q. 



X) 



C7> 

c 

4-> J* 

<D O 
CO 2 



c 
o 



X> 

o 
u 



O UJ 



C 4J 
•r- 00 

i— i — <D 

Qu CD 

X C no 
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2, Has former student received any promotions? 

Yes__ i No 

Total 



208 





Total 



Student Fpltow-up Tally Instrument ancl Composite Report s ^ ^ Page 2 

Three and/or Five Years ; " 

3. Beginning salary range;' . • . - 



otal 



under 
$75 


• .$ 75 
to 

■ $100 


$101 
to 
$125 


$126 - 
to 

$15Q 


$151 
to 
$175 


$176 
•to 

$200 


X $201 
.to 

$250 , 


$250 f 
or 
more 


• 


»\ 








• 


\ 

t 


- 



















Present salary range: 



tal 



under 
$75 


$ 75 
to 
$100 


. $101 
to 
$125 


$126 
to 
150 


$151 
to 

£ $175 


• $176 

to, 
$200 


$201 
to 
$250 


$250 
or 
more 










« <* 






—i ■ — * 



















4. Is former student employed on a job related to the training he/she had 
at this institution? 



, YES 



NO 



Total 




Total 
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Student Eollow-up Tally Instrument, and Composite Report Page 3 

Three and/or* Five Years 

5. Reason former student is not working on a job related to the training 
* he/she had at this 'institution. 



The training was not a good choice. 

Total 

Former student didn't krrow* enough about the kinds of 
occupations in which he/she might get a job. 



Z Former student didn' t know what the job was really like. 
Few jobs available >n this field. 



Former student needed more training and couldn't get it. 

Former student couldn't earn enough money; ^ 

i 

Other (Specify) . ; 



6. Feelings about the job: 



It'-S 

awful' 


Not what 
I'd hoped 
to have 


It's OK 


I .like it 


I like 
it very 
much 






j 














1 
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Student Follow ' -up Tally Instrument and Composite Report 
Three 'and/or Five Years 



Page 4 



7. Have the, job requirements changed for the occupation the student was 
trained for this institution? 



YES 




Total . 



8. Other comments and recommendations: 



NO 




Total 



ERLC 



211 

228 



Sample Document ]5 



ADDITIONAL METHODOLOGY. FOR GATHERING 
DATA RELATED TO EMPLOYER -PERCEPTIONS 



The following instrument from Trident Technical 

Collecje in South Carolina provides an additional 

methodology for gathering information related to 
empldyer perceptions. 
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• • - '. TR I DENT^TECHNICAL. COLLEGE 

CMPLt)YEy'OLlOW-UP itlRVEY 



/ 



The purpose of. this .survey is to evaluate the effectiveness of this- 
. institution.' s instructional programs by finding out how well' our recent 
graduates are performing on the job. Only the employers or. supervisors 
of graduates whose jobs are closely or , directly related to the program 
they completed should be interviewed. Try. to talk with the person who 
'is.most familiaPwith the- graduate's wo$^ Assure the employers or 
supervisors that their answers will. be^eaUed confidentially and neven 
linked to them dr to tht^jraduate. •«* ' 



Graduate Info rmation 
.Graduate's name 



Program graduate completed in 1978-79 
, Graduate's job ti t^/e 

Employer Information 

.Name of company, agency, etc. 

Street address ' ; • ; 

City and state _^ 

( Telephone number > 



'Type of business or agency - 

Name of graduate's immediate supervfeod^ 



Interview 'in format ion - p /" 

of^person actually interviewed _^ 

Position of "person interviewed 

f 'interview - 




of interviewer 
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CIRCLE ONLY ONE NUMBER- FOR EACH QUESTION. 



Page 2 



1. Relationship of person interviewed to graduate': 

# 

1 EMPLOYER 

2 SUPERVISOR -v. 

3 ' OTHER (please specify) 



2. Howlorig has (graduate) worked for you (this company, this agency, etc.) 7 

1 0 TO 6 MONTHS 

2 \7 TO 12 MONTHS 

3 "13 TO 24 MONTHS ' '*> 

4 MORE THAN TWO YEARS' 

What are nts/her basic job duties? 1 



4. What is the mijiimunt level of education you require for this type job? 

1 LESS THAN HIGH SCHOOL DIPLOMA 

- 2 ' HIGH SCHOOL DIPLOMA . 

3 ONE-YEAR OCCUPATIONAL PROGRAM CERTIFICATE OR DIPLOMA 

. * ' 4 TWO YEARS OF COLLEGE —NO DEGREE ' * 

5 TWO-YEAR ASSOCIATE DEGREE 

6 FOUR OR MORE YEARS OF COLLEGE 

7 , ■ OTHER (please specify) ; , 

5. * When (graduate) first started working for you, what do you feel were his/ 

her greatest strengths ? 



6. What do you feel were his/her greatest weaknesses ? 



7. Do you feel that, the training (graduate) received at this institution 
adequately prepared him/her for this^job? 

1 - ' NO ^ . . ■ 

" 2 YES' < • • ' 

• ■ v • - • „ \ 
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'CIRCLE ONLY ONE NUMBER FOR EACH QUESTION- 



Page 3 



Technical. Skills. 



-1U 



Compared with your other workers who have similar jobs, 1 
how would you rate this employee in each of the following 
areas? (Please circle one number for each item.) 





4 . 


NOT 
APPLICABLE 


.BELOW 

A\/P 

AVu 


ABOUT 

AMP 

i > 


ABOVE 
AVu 


8.. 


Job-Velated knowledge. ...... 


0 . 


i 


2 ' 


* 3 ■ 


9. 


Ability to operate job- related 
tools, instruments, and equipment. 


• 

0 . 


i * 


2 


3 


10. 


Other job-related technical skills 


0 


i 


2 




11? 




0 


i 


2 . 


• .3 • 


12. 


Comfnuni cation skills ...... ". 


■ 0 


i 


, 2 

* 


3 


13, 




0 " 


■ -i 


2 - 


. 3 


14.- 


Overall quality of work 


0 


i , 


2 


3- 


15. 


Quantity of work accomplished. . . 


0 — , 


.1 


2 


3 > 


16.. 




0 


i 


2 


3 


17. 




■. o 


i 


' 2 


3 ' 



Personal Skills. 



Again compared with your other workers who have similar jobs, 
how would you rate this employee in each of the following 
areas? (Please circle one number # for each item.) 







NOT ' BELOW 


ABOUT 


ABOVE 






APPLICABLE AVG 


AVG 


■ AVG 


18. 




■■ 0 l'„ 


• 2 


3 


19. 




o . i • 


2 


3 


20. 


Attitude toward job. . . . 


0 „. 1- 


■ 2 


3* 


2r. 


Ability to. follow instructions . . 


o ■ 1 


2 


• 3 


22. 


Ability to work without supervision 


0 . 1 ' 


2 


3 


•23. 


Willingness, to learn^"3TIcr"improve . 


0 1 


2 


3 


•24. 


Ability to^wprk'Well under pressure 


0 ' 1 . 


. 2 


.3 


25. 


Cooperation with fellow workers 


0 1 


• 2 


3> 


26. 


Cooperation wHh management, . . . 


o' i 


• 2 . 


3 


27, 


"Persona,! appearance, dress ..... 


"/ 0 1 


2 


. 3 
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CIRCLE ONLY ONE NUMBER FOR EACH QUESTION. 
; , ; : 1 



Page -4- 



28. Compared to' your other employees who have similar jobs, how would you 
.rate (graduate's) overall on-the-job performance? s 

1 IN THE LOWEST QUARTER 

.2 IN THE BOTTOM HALF, BUT NOT IN THE LOWEST QUARTER 

• 3' IN THE TOP HALF, ,BUt NOT IN THE HIGHEST QUARTER ■ 

4 IN THE HIGHEST QUARTER 



29. If you had an opening, would you hire another graduate from this 
institution for this type job? 



-r- 1 

2 



3 
4 



NO 

NOT SURE 

■YES, WITH CAREFUL SCREENING 
YES, WITHOUT RESERVATION 



30. Why not?' 



. 31. -Would you recommend our graduates to other employers? 



1' . NO 

■O NOT SURE 

3 YES, WITH CAREFUL, SCREENING 

.4 YES, WITHOUT RESERVATION - 



32., Why not? ' 



33. Finally, what do you think are the most important things we could do to 
improve the (graduate's)-- program? 



2 16* 
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} ■ CHAPTER ELEVEN 

COST ANALYSIS EVALUATION 



Although the fundamental purpose of .eval uation is jto make decisions 
concerning continuation, modification, or termination of occupational 
programs, you may wish to establish more specific criteria for conducting 
cost analysis study. Wentling (1980) provides the following reasons for 
conducting a cost analysis in education. 

* To Justify Resource Allocation Decisions 

When administrators or program managers develop the budget, 
they will want to know which programs provide the most 
benefits for the least cost. Moreover, allocations are 
more likely to be made to the, program for which co^ts and 
benefits have been identified than for the prdgram for which 
no costs or benefits, have been projected* Just as investors 
usually rely on information concerning historical performance 
of stocks and potential of companies, controllers of education 
and training^programs rely on historical performance of 
programs. ' j 

To Promote Better Ut 11 ization' of Facilities . 

■ 1 ■ * 

" Although costs for most programs are heaviest tn the area ,of 
staff, facilities can constitute a considerable expense. In 
some cases, it will be found that the sharing of faciliities, 
. - reduces the nominal costs for~tWo programs, and available 
facilities can be stretched to accommodate- new programs at 
little extra cost. The savings possible from the sharing of 
expenses will show up in a carefully executed, cost analysis 
evaluation* 



To Determine Optimum Staff or Human Resource Assignments 

Since staff costs constitute a" sizeable portion of the program 
budget, achieving utilization of qualified staff members is an 
important undertaking. For many courses it may Ixe true that 
the empl6yment of paraprofessional s or instructional assistants 
will reduce these costs. For example, should- it be found that 
a 1 program in health occupations requires only a half-time 
professional and can accommodate a half-time assistant, this 
program would be preferred to an alternative program that . 
requires the full-time services of a professional. 

» » 
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To Determine Optimum Load for 3 Particular Program 

(Jany times costs for a program are excessive for one class size . 
and perfectly reasonable for another. In some -cases an increase 
in class size will ccfrl for an additional staff member or an 
. assistant, thus dramatically increasing the cost per pupil or. 
instruction hour for thd program. Other times it will be. 
advisable to increase, the student load or to combine classes to 
lower the cost per s'tudent. Expenses per individual student may 
, ma.ke it inadvisable to continue a program that has a limited - 
number of enroll ees. 

\ • 

To Decrease Costs of High-cost/Low-incidence Programs 

wm ' Should it be discovered that a program that serves few 

students incurs*disproportionate expenditures, these costs 
may be reduced by seeking alternatives/ The school may wish 
to extend an invitation to other schools to share the facilities, 
benefits, and costs of the program, to the^enef it of both 
schools. Alternatively, it may be advisable to offer an exten- 
sion course in lieu of the existing program. At any rate, dis- 
covering sug+i high-cost/low-incidence programs may lead to the 
discovery of more suitable alternatives. 



To Determine the Advisability of Financing the 
Development of a New Program ;? 

Although in some cases initial costs for implementing a program 
may appear prohibitive, cost analysis evaluation may support the 
implementation of a particular program by identifying long-term 
savings that will underwrite the initial investment . In other 
cases, cost analysis evaluation may* show that implementing a new 
program is inadvisable, that the costs of implementing a new 
program, piloting the program, and developing materials will not 
prove worthwhile in the long rur>. 

o 

To Compare Alternative Programs 

Often an institution or training agency will have to choose 
between two alternative programs, both of which look very 
similar on the surface, -Cost effectiveness analysis will . 
uncover methods for discriminating between these programs and 
making intelligent choices. Decisions pf more limited scope, 
• regarding the .choice 6f competing .instructional materials, 
equipment, and techniques, can also be facilitated by cost 
analysis. * 

1 
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To Provide Fiscal Accountability 

IUis nearly*always to the advantage of the' program in 
question to keep accurate records- of the -benefits that 
Jiave been related to costs. Accountabil ity .will make the 
defense of a program possible in* the face of enlightened 
criticism. 



Cost Determination 

Determining costs of educational programs is not a simple matter. Ther 
are several methodologies that can be utilized to break down program costs. 
One useful way is to make a distinction between program development and 
program operation expenses. Examples of program development and operation 
costs are provided by Wentling (1980). 

Program Development Costs ' 

Printi ng 

Ancillary media costs 
Programming costs 
Design costs 
Packaging costs 
Evaluation costs 
Implementation costs 

Program Operation Costs * 

Instructor 
Building costs 
Administrative costs 
Materials and supplies cost 
Insurance costs 

Maintenance costs . * r 

Program 6peration costs are variable and relate to the number of 
students that one instructor can manage, or classroom space,' and so an. 
Program development costs should be calculated first, to determine the cost 
of a' program on the relative costs of two programs (Wentling 1980). 



Program Development Costs ' x > ' 

Wentling,. (1980) provides the following guidelines for tfte-*- 
de/fermi nation of program -development costs. 

Program development costs are most commonly computed for ^ 
a new course or program. - the 'types of' costs are extremely 
difficult to anticipate. Dependent upon your program's 
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idiosyncracies, these will be yours alone to identify and 
to assess. 

Following is a breakdown of program development expenses 
that may" be included in the cost calculation. 



Authoring Expense < 

Authoring expenses are fees^paid to an individual for the 
development of instructional materials."' If an individual 
external to the educational or training institution is 
utilized as an author, the fee may be an hourly, daily, or 
contracted fee. On the other hartd, if an internal staff 
member is given released time. for authoring, the percentage 
of his salary proportionate to his released time should be 
calculated. 



Pilbt Learners' Reimbursement , 

Often* a sample group will be ssked to react to specific 
characteristics' of new material, such as .its clarity or 
organization, prior to its final revision. If instruction 

'is to* be piloted, it may be necessary to pay those learners . 
who will test the material. This cost will vary considerably 
depending on the availability and age of the audience. In 

^some cases,, volunteers or captive classes can be utilized at 
no cost. * 



Content Advisor Honorarium 

Many program devel opment* activities involve an expert content 
'advisor from a university or industrial firm. The time and 
effort required to complete the task will determine the fee 
to be paid. Usually, experts will work at a daily rate or 
for. a contracted fee for completing the job. 



Material Costs , 

Material costs are those costs for supplementary instructional 
devices such as slides, tapes, games, or simulation devices. 



Layout/Design Costs , 

These costs are a function of graphic layout and design work. 
They may be related" to printed matter or may include visual 
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aides such as overhead- transparencies, sl-ides, and posters, • 
The preparation of figures or diagrams to be included in work- 
books or instructor guides are commonly recognized as belong- 
ing to this category. 



Typing'or Typesetting 1 Costs 

The preparation of material or copy to' be reproduced will 
involve typing or typesetting costs* Jyping, whether done 
by a regularly employed typist or by an additional person, is 
usually figured at an hourly rate. 



Reproduction Costs 

Expenses that are incurred as a function of printing, binding, 
s.lide dupl ication ,,tape duplication, and the like are included 
in this category. Items that are relevant to costs include 
quality and color of paper, packaging, cover stock, number of 
pages, slides, illustrations, total number of products to be 
published, type of printing used, and so on. 

Administrative Costs 

Costs related to the planning, ^organizing, and monitoring of 
developmental activity from its proposal to completion are 
considered to be administrative costs. Usually, a percentage 
of salary or a daily rate is charged against development for 
these costs. 



Evaluation Costs 

Costs incurred in the, evaluation of the developmental 
activities and the resulting product are charged to thi s 
category. Evaluation costs include staff time, external 
expert -fees (for review) and simil ar expenses. The cost 
categories presented above are related to the developmental 
activity of an instructional 'product . Additional develop- 
mental costs might include staff time for cost analysis and 
planning meetings, travel costs for visits to existing 
programs, and expenses for conferences with experts. 

JQ 

These costs may not apply to every program, and some 
programs may involve additional developmental expenses that 
have not been covered here. 
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Program Operation Costs 

Program operation costs vary froJn one academic year to the next. To 
determine the cost of a completed program, .evaluators should ex J^Jf Jheir 
records of expenditures. The following example is provided by Wentling 
(1990) to help breakdown program t:osts. 

Program Operation Per Per Per Per 

Expense Student Course Program Organization 



Instructor costs 
Building costs 
Administrative costs 
Materials cjnd 

supplies costs 
Insurance costs 
Maintenance costs 
Depreciation costs 



x x 
X x 
x x 



x 

X 
X 
X 



If projecting the costs of reinstating a program, the evaluator will 
want to know the following- 

1. 'What costs are computed on the basis of the number of students 

enrolled? 

2. How many students will be .enrolled? 

.3. What coVts are computed on the basis of the number, of sections 
offered? . 

4. How many sections will be offered? 

5. What costs are computed on the basis of the number of courses 
offered? 

6. How ma'ny courses will be offered? 

7. What costs are computed on the basis of the number of programs 
offered? 

8. " How many programs will be offered? 

9. What costs will be allocated to programs, courses, sections,, and 

students? 

10. Is it necessary to compute allocated costs? 
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Instructor Costs 



Instructor costs may be determined per individual student, 
per course, or per program. Per course or per program cost's 
may be subdivided 'and computed per student in each course or 
program. 



Material and Supply Costs 

Materials and supplies are recurring costs, expended each 
year by students and staff on a per student or per course-, 
per year basis. A preliminary estimate of supplies for a 
proposed program can be made by a pilot test of that program. 
For a program that has been in existence for some time, 'it 
is best to calculate average yearly costs over a period of 
time, then calculate the average yearly cost per student. 
This cost may be assigned to the projected number of students 
for the following year, or it may be assigned to a course 
rather than to individual students. 



Building and Maintenance Costs 

It is fortunate for the cost analyst that it is seldom 
necessary to compute building and maintenance costs j.n the 
comparative analysis of programs. These costs are normally 
allocated across disciplinary lines and the total cost per 
institution is normally unchanged regardless of the program 
that is ^implemented. 

In fact, the unnecessary computation »of building costs- may 
lead to misrepresentation of the actual benefits of a program. 

Administrative Costs* $ * 9 

Administrative costs are those co£ts ^ha't are incurred in , 
the coordination, supervision^ monitoring, and evaluation 
Of the program or programs of the education or training 
institution. The.se costs are u£ju^lly fixed by-salary, and 
it is often difficult to. assign differential amounts to 
individual program**. Thus, .it Is conjmon practice to divide " 
total administrative costs by the number of programs. If a 
particular annual emphasis is on- a one* program, it may be 
necessary, to allocate an increased'administration cost-to 
that program for the year. This allocation, in most instances, 
will* represent an estimate. 




Limitations of Cost Analysis Evaluation • 

. Johnson and Dietrich (1971)/ for example, recognize the following 
problems characteristic of cost identification: 

1. Costs are infrequently linear.. Many program and instructional 
expenses are fixed over narrow ranges whereas others are dependent 
upon enrollment, material costs, and other factors. 

2. Cost' records and data are inadequate. For the majority of 
organizations, expense categories are not in sufficient detail to 
afford accurate cost .accounting. 

3. Relevant costs are unavailable* The concept of opportunity costs is 
important iti considering how resources are utilized. 

4. Cost data on projects are unreliable. The methods of collecting on 
various instructional and program functions are as varied as the 
definitions of those functions.' m 

This chapter was presented as a guide to aid evaluators in their task of 
evaluating program costs. In addition to this material the following 
references may prove helpful in this task. 
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• , CHAPTLR TWELVE ' •.' .0 

PREPARING AND REPORTING" EVALUATION RESULTS* * 

^ ' '-, 

. p The evaluation components for most state and local education agencies 

include: (1) program planning and operational processes, (2) student 

achievement , (3) student '.employment success, and (4) requirements fort 

S4>Jbia1 populations. Procedures for collecting and processing the data have 

improved substantially since specific evaluation requirements wefe defined, 

in the federal Vocational Education Act of 1963,' especially ^with increased- 

use of matagement information systems (MIS)* The* computerized MIS in some 

.✓state and local education agencies provide numerous computer printouts 

--'revealing statistics on program enrollments* student achievemertt, and 

student employment s.uccess. Howev/er, some of this valuable information, '* 

once it has been processed and reported, is never used again. 

^valuators, meanwhile, accuse decision makers. of ignoring the data^d * 
information. Decision makers .complain because the data and information are 
voluminous, not specific, and difficult to read and understand. It follows 
that evaluators need to assess their performance in the area of preparing- 
and reporting evaluation results. t . ' 

This chapter provides a detailed' discussion on those factors considered 
to be critical for the preparation of the eval uation report. 

* Specifically, this chapter describes types of evaluative data and 
presents specific recommendations for preparing reports, packaging 
information, and disseminating evaluation findings in order to increase" 
utilization.- The focus js^on one evaluation component, student employment 
success. Emphasis is given to those data relating to product eVal uation. 
Checklist 1 asks readers to identify those strategies they employ for \_ - 



utilization purposes. 



Data Analysis 



Data analysis, commonly defined, is the tabulation^ organization, ahd 
summarizat ion of the raw information collected during the evaluation. The 
analysis .should rel.ate data to the. eval uation questions of. the study, shape 
it into some usable form, '.and determine through the use pf an appropriate 
statistical model or "practical/nonmathematical model" if the findings are 
significant or due to chance variation. 



*Stef)hen J. Franchak* and Michael H. Kean. Evaluation Handbook: Guide! ines * 
and Practices for the Utilzation of Evaluation Results . The National 

. Cgnter for Research in. -Vocational Education, The Ohio State University, 
Columbus, Ohio. 1981 p.45. 
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1 Based on the evaluation goals as they relate to the .decision-making* 
structure and decision ntakers, plans should have been made to \esi specific 
hypotheses or answer specific questions, and collect the tiata .needed. «" % 
Fitting Quantitative data to a statistical model direct^ the evajuators 1 - 
attention to certain aspects of the data and suggests inferences tha,t may be 
made. This model should be ifiade explicit and its use should be justified by 
its relationship to the decision-making structure, evaluation goaTs, and 
nature of 41a ta -collected. The' analysis may be invalid TN- 

* » 

1. relationships are not- recognized in the choice of analytical 
methods models "(quantitative, qualitative); 

2. data agtjf&yati.on ikvels are not appropriate; _ ^ 

^3. assumptions for empMsmng analytical methods or models #re 
* not satisfied,. ^ 

D^t^and Information Presentation ^ 

It is important to note the distinction between data and information: 

Information comes from data, which are logical 
" , presentations of measurements, Observations, and ^ 
* * <- computations. " Logical is here defined as orderly, 

> , intelligible, objective /and capable of , fornyrjg accurate 
relationships based on^principles-atf^Vules^of reason. y 
(Mercef and^Koester 1978, p. 85j. ; « V % * 

Not all data contain information capable of being assigned. a useful mining. 

Assigning meaning to data consists of taking the information resu^H 
from the data analysis process and subjecting it to expert scrutiny 
* an examination should explaip the'meaning of the displayed infoptft 

terms that are comprehensible, to'decision makers and other information. 4 
users: These, .assigned meanings are useful for accountability, policymaking, 
and program Improvement.. L , / 1 

* - *r • 

For example, the interpretation .of analyzed data on student enppjyment . 
success cart best be performed by the professional staff, tfie evaluator x s, Or- 
data analyst'. However, top levels'must feel comfortable- With the^ fcict v that , 
these individual organizations at either the state or local levels are \ 
acquainted with vocational programs, are credible, and 'competent evaUjators 
familiar with problems facing the managers, and have a deep conc^n for the g 
target audiences they are serving. Equally important to this process^ is the 
^need for the evaluator or data analyst to view these data as integral 
elements of a comprehensive management information system (MIS). , 
* * * f « 
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Moreover, these data need to/be considered as only one element of 
.information contained in a MIS. For example, a preliminary step In 

organizing the data interpretation and presentation function of the MIS is 
•.deciding what cVient format is appropriate. This .could take the form of a 

cross- t^toii at ion such -as programme* by function (i .e.,- personnel 
*'devel opnfent , teacher inservice,^||§riculum development, and so forth), oy a 

combination of^areas and functio^f, or by any other grouping that - 

facilitates theTpeeds of a specific education agency— state (SEA) or local 
V (LEA). . > . " 

State-and local education agencies may present employment "success in a 
variety of forms, depending upon "the target users, such as the following:. 
(1) the general public, '(2) education-.planners, (3) educational , 
administrators, (4) board of education members,' and (W) program advisory 
■committees. • * .* 

Each of these audiences has different needs. The general public does 
not usually require s detailed report. A. one-to-three page, report 
highlighting the results-' of the assessment of the former, students' • 
satisfaction with their train'ing and job may be sufficient. Educational 
' administrators and the advisory council for vocational education may be 
interested only in a one-page executive summary and a list of conclusions 
and recommendations. In contrast, educational planners, classroojii 
instructors, and placement personnel may need a detailed technical report 
to enable them to recommend or develop specific strategies for program 
changes. - State administrators ,and planners-may wantj to review final Report 
. prepared for federal Officials. 

The -interpretation ofahe evaluation data in the CraT and written 
- reports is important. CarefuTattention is required to ensure that the 
' evaluation reports are not^m^fsleaaving. 1 Many 'users Will judge the entire, 
•study effort on the basis of, the final, report. . If it is not clear and 
complete or does not reflect all of the findings and 1 imitations 'of the 
evaluation, the information may be ignored or-m1sused. There is no 
guarantee that evaluation results will not 6e misused. However, full and 
'open disclosure can help to ensure that findings are not mi sunder stood. x In 
sum/the evaluation report shoul'd^be sufficiently clear to the audience in 
its 'description of goals, procedures, and findings about what .was done, why 

• it was done, .and. what was learned. 

* . * , * • 

cr, i / i - - 

; ■- Reporti ng Recommendations 

.." \ " \ ~ < — r ' ' . - . . 

A cdmmon mistake iri report jn.g. on the assessment of former vocational ,. 
' students' employment success is to distribute the same report to all 
; audiences. Evaluators must 7 identify the audiences to whom the report is 
intended to serve and for what purpose—accountability, decision making, or 

• program improvement. It is.nojt uncommon for an LEA or an SEA to distribute 
hundreds of final report "copies of fifty or more pages* This practice 1s 

"' not only^ostlyjbut also' of questionable Val ue. The general public needs 
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Straightforward summary^friformatTon, not technical "trfVia" or sheer mass.. 
The administrator who has neither the time, nor the technical expertise to 
review the entire contents to recommend policy action or determine program 
decisions, may never rfead it. Only the educational planner, classroom/ 
laboratory instructor, counselor/placement personnel may need to know all 
the detailed information* Thus, an important consideration in the 
strategies for presentation and utilization is the length of the report. In 
a study to determine appropriate reporting formats for educational^ decision 
makers, Brickell; states:- * • • 

Top officials and management staff -were more likely to 
ask' for^shoYt reports; program and project specialists 
were more likely tb request medium or long reports in their 
areas 'of specialization (p. 99.)* 

As a rule of thumb, short reports average one page, three minutes reading 
time; medium reports, ten pages, fifteen minutes; and long reports, one 
hundred pages, sixty minutes (Brickell 1974, p. 99). 

' The alternative reports on student employment success mustjie weighed in 
terms of the targeted reading, audience. At the state level, all three 
reports— short , medium, and long--should be prepared. If the state conducts 
the assessment <of student employment success of forfoer students or a" sample ^ 
of "the* total population, it seems advisable that it also prepare statistical" 
reports for each of the LEAs. At the local level, the detailed report and 
the r executive summary should be minimum requirements. 

' > 
r < 

Graphic Presentations ^ m 

Graphic presentations are an extremely useful and efficient medium for 
the presentation of quantitative data in a manner that facilitates the 
comparison of values, trends, and relationships. Graphic displays have * 
qualities' and values lacking in a narrative presentation: , : * 

1. They .are more effective in creating interest and catching 
the attention of the reader. * 

2. They provide visual relationships that are more clearly * $ 
grasped and more eas*ily remembered. 

.3. They are more time efficient, since the essential leaning 
of large masses of statistical data <ran be assimilated, at a 
glance. ^ ' 

4. They* provide a more* comprehensive 'picture of the problem, 

t making for a more complete .and better balanced understanding,^ - 

5. ' They stimulate and facilitate analytical thinking and 

investigation, which brings out hidden facts and relationships." , 

' ••;'•„• 
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Graphic presentations may 'take any of the following forms: 

1. Rec tilinear coordinate charts — The> most frequently used of this type 
is the simple, arithmetic, line chart. A number of useful variations 
exist; the cumulative curve chart, staircase curve chart, 

• • simple-surface <5r silhouette chart, staircase surface chart, 

' multiple-surface or band .chart, and the 100 percent surface .chart. 

2. ' Ear and column charts —The major use of these forms is to facilitate 

the visual comparison of the magnitude of coordinate items or parts 
of a total. The bars in a bar chart are arranged vertically .in a 

•column. Basically, there "are" at least eight types of bar charts: 
the simple bar chart, the bar-and-symbo-1 chart, the subdi vided-bar 
chart, 'the subdivided 100 percent bar chart, the grouped-bar chart, 

/the paired-bar chart, the deviation-bar chart, and the sliding-bar 
chart .* 

There <ire also eight bas^types of column charts: simple column 
charts, connected-col umn- charts, grouped-col umn charts, 
. subdivided-column charts, net-deviation column charts, 
gross-deviation column chart's, floating-xolumn charts^ 
gross-deviation column charts, floating-column charts, and range 
charts. 

3. Semi logarithmic or ratio' charts— Thi s type of chart is .especially 
suitable for showing proportional and percentage relationships. It 
is a good method for portraying rates of change in a graphic way. 
This type of chart not only correctly represents relative changes, . 
but also indicates absolute amounts .at the same time. The vertical 
axis is ruled logarithmically, and the horizontal axis, - ■ 
arithmetically. The continued narrowing of the- spacings of the 
scale divisions on the vertical axis 'Is characteristic of . 
logarithmic ruling.- On the other hand, the equal intervals on-the 

'horizontal axis' are indicative of arithmetic ruling. This chart is 
also sometimes referred. to as a ratio chart because of the 
proportional relationships that it portrays. 

4 # Frequency graphs and related charts —There are three basic types of 
1 simple frequency gnaphsi frequency polygon, histogram, and smoothed 
frequency Curve/ The- cumulative- frequency graph or ogvve is well 
suited to the foil owing ^ purposes: (a), to determine and show the ^ 
number of proportion of cases' above or below a given value, and (b) 
to compare two or jnore frequency distributions. 

Probability graphs are' based on the normal frequency curve. This 
method provides 4. test for proportional asymmetry as well as 
demonstrating comparison? between empirical and theoretical 
distributions and prediction. 
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5. Miscellaneous graphic forms— The pie chart may be used to show ' 
component relations. The various segments of a circle represent * 
component parts of the total* The trilinear chart simultaneously 
portrays three variables in the form of elements of a single 
function of activity. It is always a 100 percent chart, since the 
sum of the three values indicated is equal to 100 percent. ■ 
Trilinear charts are especially useful in portraying operating, ♦ 
production, or other costs expressed by a threefold breakdown. 

The scatter diagram (scattergram) and other types of correlation 
charts show in graphic form the degree and type of relationship or 
covariation between two series of data. In statistical terms, the/ 
relationship between two or more variables is described as 
correlation. The fan. chart portrays change for two different 
periods either by percentages or index numbers* As many as ten or 
fifteen items may be shown, depending on the range and scatter of 
val ues. 

Ranking or rating charts place emphasis on<the position of certain 
items or categories. This position is usually based on magnitude or 
frequency. Therefore, emphasis is placed on rank-order position, 
rather than on the values themselves.* 

The most effective way of showing spatial relationships is the map. 
Maps are often helpful An locating problems, testing hypotheses, 
analyzing data, and di scovering .hidden facts and relationships. The 
following basic types of maps may be useful in portraying 
statistical data: (a) cross hatched or shaded maps, (b) spot or 
point- symbol maps, (c) isoline maps, (d) maps with one or more types 
of graphs superimposed, and (e), a combination. of two more of 
the preceding types. 

Pictorial graphs and charts may be used with popular reports which 
' are prepared for nontechnical "use. They add interest for the reader 
who may not be otherwise motivated to look at the item. Charts 
»r drawn in projection have limited use in vocational information 
packaging, largely because of, the complexity involved in designing 
three-dimensional pictorial graphic forms that are distortion-free. 

This is a very brief outline of some graphic forms that vocational 
education eval uators may consider for reporting evaluation results. The 
reader is referred to figures 1 through 7 for selected ideas. for developing 
graphic displays. A more detailed description about each specific type with 
numerous examples may be found by consulting the fol lowing references: t 

AT & T. Making the Most- of Charts: An ABC of Graphic 
/. . Presentation . Washi ngton, D.C. : Navy *Pub1 ications* and 

Printing Service, November 1970. 
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Schmid, C.F., and Schmid, S*E. Handbook of Graphic Presentation , 
New York: .John Wiley and Sons, Inc., 1974, 

Starr, H. et al. Selecting, Analyzing, and Displaying Planning 
Information . Columbus, OH: The National Center for Research 
in Vocational Education, The Ohio State University- 1979. 

A thorough discussion of technical strategies and techniques to aid 
evaluators in communicating their evaluation results is found in the 
publication, A Communication Handbook for Researchers and Evaluators by 
Hoi ley et al . (1979).- : ] 



Preparing the Content and Information Packaging 

Information about vocational programs is generally prepared for one of 
three types of functions: (1) public information/relations, (2) 
administrative decision making, and (3) program decision making. Each 
requires a different strategy for content development and style of 
packag^pgr^Under normal circumstances, it is not advisable to photocopy the 
comcj^er- generated printouts for distribution. The three types of functions 
Torwhich information is prepared and packaged are treated separately in the 
following discussion. 



Public Information/Relations 

This function is one of keeping the general publ ic informed about the v 
needs and achievements/of vocational education.' The information must be 
packaged in as simple and efficient a way as possible. Very elementary 
visual displays such as charts and graphs are highly recommended. 

Whether graphic or tabular techniques are used, three 
factors underlie satisfactory display of quantitative 
data: simplicity, clarity, and effectiveness. The 
graphic and tabular forms of data display must be easily 
read and understood, and must be presented in a manner 
which will facilitate ease of comprehension and detention. 
These purposes require consideration of: (a) the nature 
of the data; (b) the purpose of the display; (c) the medium 
for presenting' the data; and (d) the audiences to whom £hQ 
data are presented. One or all of these factors may be 
pertinent to any situation where data are presented or 
displayed (Starr et al. 1979, p. 61). 

When the visual display is complete, it should be examined critically in 
light of the following questions: 

1. Does' it convey the intended message? 

2. Does it display the relationship clearly? • 
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3* Can it be displayed differently? 
* 4, Does it have eye appeal? . . , 

Although these are basic requirements, more often than not individuals who 
package information fail to address them and thus run the high risk of 
failing to communicate effectively to the .intended audience. 



Administrative Decision Making 

Contrary to popular belief, decision makers are generally not voracious 
report readers. Many simply do not have the time to do extensive reading 
and analysis. Because decision makers tend to be oriented more toward oral 
communication, it would obviously be a waste of time and effort to provide , 
them with extensive sets of uhsynthesized data, expecting them to do their 
own analysis of outcomes relating to problems .they ar>e<trying to solve. 
Decision-making information offered to managers should be synthesized and 
packaged into a very practical, usable, "palatable" form. Charts and tables 
of (Jata need to be clear and concise for immediate understanding. 

A great deal of responsibility rests on the evaluation .or. data analyst 
who must, interpret and package the information for dissemination. 



Clients involved in program development at eithfer the state or local 
level should receive the detailed report and the executive summary. The raw 
data and processed information may also be prepared for individual 
institutions and' agencies. 

• Care must be taken to-maintain confidentiality of data and information. 
Schools should of course receive all information and data for the LEA and 
region as a whole. In sharing such detailed data/informa.tion from 
individual schools with other schools, consideration must be given to the 
federal legislation requirements for the confidential ity and protection of 
individual rights. 



Factors to Consider in Increasing the Use of Information 

The development of working relationships, both within the organization 
and among members of different organizations, is extremely important. One 
important internal working relationship is the linking of evaluation 
information with people involved in planning, programming, operations, and 
compliance. Here, the development of a'conceptual framework is extremely 
important. This involves the development of tactics, strategies, and 
procedures. * 

*A fundamental question for school improvement "is , how does change take 




Program Decision Making 




place. One can pobo.it that it takes place in part through the use of 
existing 'systems. Mother way is through a reordering of priorities. 

Who 'are the key actors in this change or use process? Linkers and 
change agents are among those most cpnmionly defined as such. Many linkers 
and change agents already exist in schools; e.g., teachers and curMculum 
coordinators. The problem is that those individuals do not visualize their 
potential for the role. The challenge then is to adjust their focus on 
problems concerned with chdnge or evaluation use— for example, allocating 
resources, developing communication skills, and implementing diagnostic 
procedures. • • 

The importance of having clients participate in the design of an 
evaluation plan cannot be overstated. Meaningful collaboration—working 
within an existing network or developing new networks—is essential. 

Effective linking of developers, users, and evaluators begins with an 
awarenes^ of what information systems do exist, either formally 'or 
informally. Serious considerations should also be given to using 
cost-effective commun icatiorvs technology, such as the electronic newsletter. 



User-Oriented Mode 

Another suggestion for increasing the use of evaluation data and 
information is to follow a user oriented mode rather than- a product oriented 
mode. Again, plans should qffer efficient service at a reasonable cost. A 
number of strategics -are available for the evaluator. With regard to 
efficiency in $ people oriented mode, the telephone as a medium for delivery 
car> increase the probability of utilization. Another important strategy is \ 
to-make initial contact. and serve people with enthusiasm. Also, one must 
take into considerat ioji the differences that exist among local school needs,' 
state education agency needs, and individual needs. In all cases, the 
information should be made available in a timely manner. The development of, 
a network of coordinators can be a most cost-efficient method for 
.transmitting evaluation data and information., An ombudsperson, can serve. as 
a key to this network- concept. This reduces the number of direct contact 
points for the evaluator, and allows for the network to serve as a 
multiplier in dissemination. Other modes of communication that the 
evaluator can and should use are the news media, conferences, newsletters, 
and meetings with col lego and inservice classes. 

Lffoctive dissemination and use of evaluation results seldom, if ever, 
occur by accident. They must be planned. Hull and McCaslin (1977) offer 
thirty implementation techniques that represent tools that can be used to 
influence people toward implementing, innovations. A number of those 
techniques can be considered by the vocational' education eval uator for 
enhancing the use of evaluation results. For example, an evaluator should 
establish an evaluation utilization council composed of teachers, program 
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supervisors, teacher educators, parents, students, employers, and state 
education officials. This council can serve as a sounding board to review 
.and advise on the packaging and dissemination of the evaluation results. 
There needs to be effective delivery of usable information, and a 
significant effort must be made by the evaVuator in focusing on the 
attitudes of potential users. Checklist 6 presents ideas for organizing the" 
eval uation council . 

Strategies and procedures for the use of evaluation must be targeted on 
.the user groups. The evaluator needs to describe the potential use of 
evaluation results to individuals and groups. Specifically, the decision 
setting(s) and decision type(s) of client groups such as students, teachers, 
administrators-, and legislators must be analyzed individually or 
collectively. The analysis should focus on their use requirements in regard 
to program planning and operational processes, student achievement, and 
student employment success. In sum, a number of factors or conditions exist 
that contribute to-ttie utilization of evaluation results. But it is the 
, preparation and reporting—as one might say, the "summative activity 11 — which 
often determine whether or not utilization occurs. * ■ 



Scenarios of Evaluation Utilization 
t - ■ — ■ ■ — - — 

There are innumerable variables associated with the decision-making 
process which affect the complex nature of vocational education change. The 
utilization of evaluation results for effective change is merely one segment 
of the total process of change, but should .never be underestimated as a 
critical component. 

The following scenarios depict instances where evaluation results were 
employed in the decision making process. In each scenario an evaluator is 
speaking. These examples were adapted from Weiss 1977, Patton et al., 1978, 
Alkin, Daillak, and White 1979, and Franchak and Spirer 1978. 



Scenario 1 

Annual vocational education graduates 1 employer surveys in a large 
school district revealed that graduates lack essential employability skills. 
A closer look indicated that some students did not know hQW to properly fill 
out an employment application, how to conduct themselves in a job interview, 
or how to keep a job once they found one. 

The vocational education director, other administrators , and occupa- 
tional specialists met and formulated a plan to better prepare students for 
entering the job market. In several large high schools, a separate course 
on "employability skills" is now offered at the ninth or tenth grade level. 
Furthermore, every high school, regardless of size, has instituted a unit of 
employability skills in certain academic and all vocational classes. These 
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CHLCKLISr 1 

STRATEGIES FOR IMPROVING THE 
UTILIZATION OF EVALUATION RESULTS 

Identifying key decfsion makers 

Establishing utilization goals and objectives 

* » 

< 

Creating a follow-up and follow-through 
utilzation plan 

Providing technical assistance 
Monitoring activities to -affect use 
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FIGURE 1 

{three-Dimensional Bar Chart) 
TOTAL ENROLLMENTS BY PROGRAM, 19-/19- 
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Vocational Program Code: 

1 Plastics Technician . - 

2 Horticulture Production 

3 Livestock Management 

4 Fashion Retailing , 

5 Insurance 

6 Marketing 

t ,7 Accounting 



8 Quantity Food Preparation 

9 Auto Mechanics 

10 Practical Nursing 

11 Data Processing (keypunch) 

12 Cosmetology 

13 Interior Design 
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FIGURE 2 



{Line Graph) , 

10TH-12tH GRADE. ENROLLMENTS BY PROGRAM, 19-/19- 
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- FIGUAE3 

(Bar or Column Chart) - 
MONTHLY SALARY OF EMPLOYED VOCATIONAL PROGRAM GRADUATES 
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FIGURE 4 

(Bar Chart) 
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FIGURE 5 

^ (Column Chart) 
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FIGURE 6 
(Bar Chart-Shading) 



AGRICULTURE 

DISTRI8. ED . 
* HEALTH 
HOME EC. 
BUSINESS 
^TECHNICAL 
TRADE/IND. 



POST HIGH SCHOOL ACTIVITIES 
OF THE 19 — GRADUATES 



ITS m4 



'25 



Z3S 



1 i£ 



250 



760 75 100 



(Overlapped Bar Chart) 



\ 



IF 



IF 



t i EMPLOYED 



NOT IN LABOR 
FORCE 



IN SCHOOL/ 
COLLEGE 

1N THE 
MILITARY 



UNEMPLOYED 



24 1 



257 



FIGURE l/T 
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, CHECKLIST I 

Factors and Conditions that Contribute 
to the Utilizatioa.of Evaluation Reflifts 



Rating of Importance 



Factors and Conditions 



Ver y 
Important 



1 

2. 
2 

4 

•5 
6. 

*7 
8. 

. 9. 

10. 

11. 



Prespecihcation of goals* and objectives 

Identification o\ decision makers 

Understanding of tlip decision making ~ 
communication, arra innovation processes 

Identification of informational require 
monts relevant* to decision making 

Evaluation report provides ( lejr : 
drrectioo for future planning 

Evaluation results support the decision 
makers' ideology ^ 

Evaluation results suggest K t tie or no 
change 



13 
14. 
lb 
16 
17 

18 



Evakiator assumes active role in 
promoting utilization 

Presence of a formalized evaluation 
system 

Standardized tests matching objectives* 

Use of reliable and valid instruments 

Evaluation results which support an 
organization's continued existence 
(results not at variance with orgam 
zational goals) 

Evaluators are internal to the > 
organizatton 

Evaluators are external to the 
organization 

Involvement of evaluators early in , 
development pf program or project 

Place of evaluation capability i« the 
organizational structure 

Responsibility foi evaluation at a 
level appropriate to the decision 
makers which evaluation is to assist >J l 

Use of classical experimental reseaich 
designs* in evaluating programs 



Somewhat 
Important 



Not too 
Important 



Not 
Important 
At All 



2 
2 

2 * 

2 

2 

2 

2 

2 

2, 
fc 2 
2 

2 
2 
2 

2 , 
2 

2 
* 2 



3 
3 
3 
3 

3' 

3 

3' 

3 
3 
3 



a: 

3 
3 

3 
4 3 



4 

4, 
4 
4 

-4 . 

4, 

4 , 

A . 

,4 
A 
4 

4 

4 

4 • 
4 

4 ^ 
4 



Don't 
Know 




5 
5 

5 

5 

5 

5, 

5 

5. 

5' 
5 
5 

5 
5 
5 
5 
5 



4\ 



ERIC 



. 2/1 3 



-259 



Checklist Z (continued) 



Factors- and Conditions 



Rating of Importance 



Very SoroewTfat foot too 
Important Important Important 



r NOt 

Important 
At All 



Don't 
Know 



19. Developing evaluation reports 
according to the function or 
role of the individual or groups 

20. Involving the program staff or 
persons being evaluated in the 
design of the evaluation study 

21. Extensive use of graphics in 
development of the evaluation 
report 



V 

1 1 



* 2 



2 



5 

'5 



• / 
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**T FIGURE 8 * 

t 

Factors to Consider in Preparing an Evaluation Report . 

l/* Include the survey instruments, m all reports and presentations, if possible. 

2 Set up focal reports basetJ dpon local requirements, but also include information required by state and federal 
, mandates thai relates to local programs receiving state and federal support. • 

♦ * " f 

Break down and analyze data as much as possible, but not all information and analysei need be presented 
to everyone, ^ fc. * 

Make tabular summaries in the shortest possible form. Oral presentations are best with this type of 
information, Folfow survey form design when making presentation, question 1, 2, 3, and so forth. 

Prepare and present a copy of the report to each member of the audience during oral presentations, tf * * 
piaclical Be sure to present data in the form and content applicable to the particular audience. 

Summarized reports are usually tbe best format for presentation to most groups, however, more definitive 
information is required in certain instances. * 



3 



6 



7. The comments section of a survey instrument is very important. This area many times' reveals needs and 
shortcomings, especially if a particular comment is repeated several times. 

8. Scan the comments section for the most frequently mentioned items, and make summaries for inclusion. in 
'reports and presentations Refrain from using actual names (teachers, administrators, etc.) given in comments. 

- \ , 

( 9 Do not attempt to include surwey information from a student surveyed in the wrong curriculum area. For 
t example, students are sometime* included m vocational surveys that may have only taken one vocational 
course. ^nd are in fact pursuinq college pre>xourses. Their inclusion in a vocational survey biases the 
information and increases response error* 

10. Data tabulation and analysis methods must be appropriate, or nonuse oT tTie data is assured? 

1 1. Bre*ak out district data.on a per school or program per campus basis. Most administrators are interested in 
information dbou-j their institution and theic^acluates Compa^schools to county clata, or program to 

- 'program data, but avoid institution to institution comparisons.. 

12. Break out data by program, whefrr applicable. This format is very meaningful for vocational reports and 
. presentations. It gams teacher support for the activity. 

13. Compare ahd present data on courses and programs, not teachers. Many students reactTto questions a£out 
courses or programs by the nature" of their relationship with a teacher, which biases the data. 

14 Keep any sophisticated statistics m a separate section for those who wish to review them, but do$ot present 
statistic* throughout a report Rates of Use will go dowin. especially in audiences with little or no background 
in x research methodology ' 1 

15. Percentages, graphs, and chart* are information display methods to which most populations can best relate. 

16 The main use of follow up information as it currently txists is to display general indications of %he condition 
of an institution, district, and so forth. Include an abstract of each report that summarizes these findings 
and gives a brief description of the information gatlierrng analysis techniques. ' 

17. Make sure reports appear neat, are printed on good quality paper, and are in readable form. 
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uniCs are taught depending upon the situation* The program has met with 
favorable comments, from employers and students, and recent survey data have 
tended to substantiate the changes. \ 

Scenario 2 

Employer .surveys from a small community col lege revealed that some 
graduates of business programs were failing to meet, the minimum typing 
performance standards required in certain occupations. The head of the 
business department checked all typing ]5T*e$c4ms^and noted that procedures 
for. testing typing, speed and accuracy were'^not consistent with those used in 
business and industry. Because the word-per-minute rates were somewhat 
higher inr the employer^' tests than in the classroom tests,' some students 
consequently failed to meet the minimum performance -standards demanded in* 
certain job situations. 

Consultations were held between the business staff members and 
individuals from gov'ernment ; business, and industry to develop guidel ines 
and procedures for teaching and testing typing skills to matchN^ose o/ten. 
required on the job. Subsequent follow-up surveys have revealed a sharp 
drop i 13 adverse comments pertaining to inadequate "typing skills. 

Scenario 3 ■ 

The eval uation, study served two -purposes. One was that it resolved a 
lot of dojjbts, confusions and misunderstandings that our state advisory 
committee for vpcational education had, and second, gave me additional 
knowledge to support facts that I already knew, and, as I say, broadened the 
scope more than I realized* **' 




Summary 



In summary, interpretation and packaging ~bT~ data and information on \ 
student satisfaction with their training and job requires strict~attent4on~ - 
to the needs and characteristics >of the audiences for vthich the information 
wiM be prepared^. Figure 8 identifies general factors to be observed in 
organizing and formatting a report, and considerations fW.tfie graphic 
display of data. Thfc reader is encoijraged to review the 1 summary checklist 
(numbej 3) For strategies and techniques .for improving the utilization of 
evaluation results.* h \ 4 m 
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CHLCKLIST 3 

SUMMARY OF STRATEGIES AND TECHNIQUES FOR 
IMPROVING THE UTILIZAJION OF EVALUATION RESULTS 

Have you considered the need to do the following : 

1."' Identify the clients, of the evaluation 

• 2. Stress the importance or vitality of .the program » 

3. Encourage active client participation in 
implementation of the evaluation 

'4. Guarantee the technical purity of thie evaluation 

5. *Use a variety of reporting and presentation formats 

' o./Vlan the sequence and determine the frequency of 
dissemination * ' - 

7. Key the results to the timing of decisions 

8*. Include an assessment of those objectives important* 4 
to cl ientfs 



j 



9.'* Brief decision makers in- advance of the release of 
• the avaluationr information 

10, Deal with areas of resistance 

11, Use an ombuds person ^ 

12, Adopt an entrepreneurial .role 

13, Use an evaluation audit ; 

14, • Estat?nirttie-credejrtial s of the evaluator 
-15. Be aware of key power brokers in the^pTbgram— 

16. Work with media representatives 

17. Present the evaluation as an integral part of a v 
management support system 

18. ' Be concerned with the political impact of Rositiye 

results < • ' 
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Have you considered the need to do the following : 

19. Be concerned with the fiscal possibilities of the 
findings 

20. Broadly distribute the findings 

c 

• 21: Be brief in presenting evaluation results 

22. Emphasize the non-technical aspects 

23. Key the language of the evaluation report to 

the audience 

** * \ 

24. Establish the credibility of the findings by using 
an external reviewer 

25. Compare the evaluation with similar reports 

26; Be alert to special problems inherent in the 

agency or program's environment* * 
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Bullpitt, Oorna. Program Evaluatio n Process , Olympia , Washington: Olympia 
Technical Community "Col lege ,"1980. 

\ comprehensive program evaluation system involving faculty, 
administrators, advisory committee members, former students, and student 
employers. The system is somewhat complex but provides for a -quantitative 
analysis and assessment profile. 



Community College Occupational Programs Evaluation System / California: 
Chancelor's Office, The California Community Colleges, 1978. 

COPES is an acronym for Community College Occupational Programs 
Evaluation System. COPtS 1 function is to help a college assess what is in 
relation to what is desireable in occupational education by providing 
efficient procedures and instruments for studying all aspects of 
occupational education. .Professional assistance in applying the system. 
Along with SAM (Student Account abi 1 1 ty -Model ) , COPES; is 1 part of the 
statewide community college occupational education program evaluation and 
reporting system sponsored by the Chancellor's. Office, California Community 
Colleges. Jhe following seven 'Forms are utilized is^this syftem: 

v Form 1 COLLEGE SELF-APPRAISAL OF OCCUPATIONAL EDITION PROGRAMS AND 

SERVICES, completed by the president or his designate and signed 
t>y the president.. Represents the college official position. 
Consists of Part A-Basic Factual Information, Part 
B-Quantitat i ve % and Qualitative ratings of program standards and 
appended forms: 

Form 1 - College Self-Appraisal of Consumer and 

. Homemaking Education Program/Services. * 

Form 1,- College Self-Appraisal of Program .to Achieve ' 
Sex Equity 

Form 1 - College Self-Appraisal of Programs/ 

Services for Special Populations: Dis- 
advantaged, Bisplaced Homemaker, 
Handicapped; Limited/Non-English 
Speaking. . " 

Form 2 * FACULTY APPRAISAL QF SPECIFIC OCCUPATIONAL PROGRAM, 
completed by full-time occupational instructors. 
Concensus ratings for each USOE Code 6. digit program. 

Form 3 - ADMINISTRATOR AND COUNSELOR APPRAISAL OF OCCUPATIONAL ' 
f DUCAT I ON, completed by administrators .and counselors 
selected by the college for self-study participation. 
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Form 4 - PART-TIME FACULTY PERCEPTIONS OF OCCUPATIONAL 
EDUCATION, completed by part-time occupational 
J instructors. 

Form 5 - STUDENT PERCEPTIONS OF OCCUPATIONAL EDUCATION, 

completed by students enrolled in occupational courses 
may be separated into SAM (Student Accountability 
Model ) B and C students. - 

Form 6 - ADVISORY COMMITTEE PERCEPTIONS OF OCCUPATIONAL , 

"EDUCATION, completed by occupational program advisory 
committee members. 

Form 7 - SUMMARY PROFILE BY SITE VISIT TEAM, completed by 

validation team, includes Quantitative and Qualitative 
* ■ ratings of program standards and appended forms. 

Disadvantaged, Displaced Homemaker, Handicapped, 
L imi t ed/ No n- E ng 1 ish , Speaking. 

Copa, George H. , and Kleven, Bruce A. Job Selection Patterns: Linkage 
Between Vocational Education Programs and the Labor Market . 
Minnesota Research Coordinating Unit -for Vocational Education, 
Department of Vocat ionaT and Technical Education, University of 
Minnesota, 1977. 

The purpose of this study was tq^ develop and test a concept of defining 
the linkage between vocational education programs and t belabor market. 
Definition of this linkage is an important factor in planning vocational 
education programs to ensure gainful employment opportunities for program 
leavers. Specifically the objectives were as follows: 

1. Describe the pattern of jobs selected by graduates s 

2. Assess the stability between years of the pattern of ^ 
jobs selected by graduates * 

3. Describe the pattern of geographic location of jobs 
selected by graduates 

.4. Assess the stability between years of the patterns of 
geographic locations of jobs selected by graduates 

5. Assess the longitudinal stability of the patterns of jobs 
selected by graduates 

With these objectives achieved, managers and teachers of vocational 
education can put labor market demand information in a more valid 
perspective when planning and evaluating vocational education programs. 
Instrument provided. ■ 

* * 

Darcy, Robert L. Vocational Education Outcomes: Perspective for' Education . 
Research and Development Series, no.. 163. Columbus: The National 
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Center for Research in Vocatu<>. jc.i ion, The Ohio State University,- 
- 1^79. 

This document deals with the theory and practice of vocational education 
outcome evaluation. The purpose of the publication is to aid in answering 
the following questions: (1) What particular outcomes are appropriate for - 
•use as criteria to evaluate vocational education programs and (2) What 
procedures can be utilized t^ evaluate vocational programs .in terms of these 
outcomes? 



Easoni, Kenneth C; Hulsey, "Judy -J. ^aylor, Judy L.; and Wilson, James W. 
local Educational Assessment Program .. Athens Area Vocational-Technical 
School. Georgia. Department of fducatibn, 1978. ^ 

The Local Educational 'Assessment Program (LEAP), was developed for a 
specific purpose: To develop a mechanism' 'for local institutions that would 
provide for institutional, program/^nd individual improvement in the 
educational process. Project LEAP fs subdivided into seven guides that have 
been developed to assist vocational-technical institutions in conducting a. 
systerinzed approach to local evaloatio.n.' 

With the exception of Guide 1, Introductory; and Guide 7, Institutional 
Program and Staff Development; each guide ;coatai ns four sections: (1 J GOALS 
AND OBJECTIVES; (2) PROCEDURES FOR ADMINISTRATION; (3) PROCEDURES FOR DATA 
•ANALYSIS; AND (4) MODEL INSTRUMENTS AND DOCUMENTS. 
-* • 

The first ^section, GOALS AND OBJECTIVES, defines potential outcomes of 
the particular'-aspect of local evaluation. The second section, PROCEDURES 
FOR ADMINISTRATION, provides a suggested step-by-step sequencing of tasks 
leading' "to- tfc> accomplishment of the objectives. The third section 
PROCEDURES -.FOR DATA ANALYSIS, presents a suggested method for organizing the 
.information gai'rted into usable data. -.The fourth section, MODEL INSTRUMENTS 
AND DOCUMENTS, contains copies of instruments and documents that were 
developed and field ^tested as part-of this- proj-ect. 

.A brief description" of- the seven guides included in this model is as 
follows: • 

Guide 1, Introductory — The" Introductory Guide provides a system 
♦ overview that includes a rationale, acknowledgements, and design 
components. Also included are suggestions for implementation 
and utilzatvon i it the local setting. 

' 'tjUige 2,, Consultative Team Evaluation —The Consultative Team 
Evaluation Guide provides a procedure for conducting a needs 
assessment by a team of experts from related business and 
industry. The LEAP Matrix in this introductory guide depicts 
the factors and indicators assessed by the consultative team 
|va)uation and also includes the derivation of the sample 
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instruments used in the assessment ^process, the guide con- 
stains sample documents .and instruments that may be used as 
a basis for this type>-external' assessment. *. ( 

Guide 3, Student Perceptions - -The Student Perceptions Guide 
presents a suggested methodology with sample documents-, for 
conducting a Needs Assessment with in-school students. The 
matrix in this introductory guide depicts the -factors and 
indicators assessed by the students and also includes the 
derivation of the sample instruments used in the assessment 
process. • , r ; . 

Guide 4, Instructor Percept ior>s --Tfre Instructor Perceptions ^ 
Guide presents a suggested-methodology, with sample documents, s 
for conducting a needs assessment with institutional instructors 
The matrix in this Introductory Guide depicts the factors and 
indicators assessed by the instructor and also includes the 
derivation of the sample instruments used in the assessment 
process. „ 

Guide 5, Administrative and Supervisory Perceptions - -The 
Administrative Perceptions Guide presents a suggested 
methodology, with sample documents for conducting a ne£d§ 
assessment with the administrative and supervisory staff. 
The matrix in this Introductory Guide depicts the factors and 
indicators assessed by the administrative and supervisory 
-staff and also includes the derivation of the sample instru- 
ments used in the assessment process. s . * 

Guide 6, Follow-up and Cost Analysis Guide —The Follow-up and 
Cost fffectivenes Guide provides a suggested, procedure, with 
sample documents, for conducting a needs assessment from the 
external sources of former students. jfhis guide also suggests 
various uses of extant enrollment and^Racement data that should 
be available within the local institution. Also included is a 
cost effectiveness computational method that may be used for 
relative comparison of ^institutional programs. The matrix in 
this Introductoity Guide* depicts the factors and' indicators 
assessed by these sources and also includes the derivation of 
instruments used in the assessment process. 

Guide 7, institutional, Program, and Staff Development —The 
Institutional , Program, and Staff Development Guide provides 
suggested method to organize and implement improvement, 
activities designed to fulfill those- institutional , individual, 
and program needs identified through the needs assessment 
process. 
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Franchaki Stephen J., Keun, Michael M. Evaluation Handbook: Guidelines and 
Practices ffrr the Utilization of Evaluation Results , Columbus: The 
National Center for Research in Vocational Education, The Ohio State 
University, 1981 . . 

The. primary purpose of this handbook is to help state and local 
vocational education personnel responsible for evaluation increase the 
utilzation of ^eval uat ion results. Section 2 reviews federal, state, and 
-local requirements for vocational education evaluation. Section 3 
highlights theories and processes of communication, decision making, and 
innovation that influence utilization of evalution results. Section 4 
identifies relevant problems and discusses a variety of approaches . 
recommended to promote utilization, such as identifying an audience, 
- targeting a report, dealing with areas of resistance, and establishing 
credibility. The final section further examines reporting dissemination 
strategies and presents tour scenarios illustrating situations in which 
utilization has occurred. 

Franchak, Stephen J., and SmTTey ; tarry~TT~ E Wl uat fug H^ixdboolc: —fori del i nes 
and Practices for Measuring Employer Satisfaction with^Training and Job 
Performance of Former Vocational Students . ~~ " ~ " " 

The purpose of this document is to identify exemplary strategies and 
procedures to help guide the design and implementation of studies for 
assessing employer satisfaction with former vocational education student's 
training and job performance. Specifically, the handbook provides ideas for 
initiating such an assessment or for improving upon current practice. In 
addition, it focuses on problems and issues related to this type ( of 
evaluation activity. This assessment of employer satisfaction falls under 
the category of prografn evaluation or impact evaluation. 

Gray, Kennfey E-; Abrain, Marie, and McKinney* Floyd. Vocational Education 
Measures: Instrum ents to Survey Former Students and Their Employers . 
.Columbus: ~. The National Centfer for Research in Vocational Education, The 
•Ohio State University, 1978. ' * 

This handbook of vocational education measures was developed to provide 
a useful resource of instruments and supporting information to individuals 
who are responsible for developing and conducting evaluations of vocational 
education. This document contains gn assortment of instruments currently in 
use or available for use in selected state vocational education agencies,' 
secondary and post secondary schools or business and industry. The purpose 
of this publication is two-fold; it is designed to help practitioners 
determine their needs and select an instrument. that is appropriate to meet . 
those needs; further, it can assist the practitioner in meeting the 
evaluation requirements of federal legislation. . . 



• ERIC 



25 9. 



'271 



Harris, Zelma., and Eros, Dawn; {dentif ication. Description and Evaluation 
of Vocational Education .Programs at Metropolitan Community Colleges in 
Kansas City Missour? : Kansas City: ,The Metropolitan Community ■ 
Col leges Administrative. Center 1978. . ' . 

This document describes a vocational education curriculum evaluation . - 
model. The model is based upon the .following criteria; • 

1. Program's relationship to job'markejt profile* 

2. Program's level of occupational community support . 

3. Program's success in meeting vocational aspirations of past » • 
and present students 

4. Program's success in terms of student performance 

5. Program's cost effectiveness r 

6. Program J s success in meeting the needs of handicapped , 
and disadvantaged students • 

7. Program's success in demonstrating sex fairness t 

' Data were primarily analysed through the application of descriptive 
statistics, to produce a profile constructed so as to provideadmirnstrators . 
and other interested persohnel an evaluative overview -o* a pro-am' s 
strengths and weaknesses on each of the criterion measures. Afr-Jjit standing 
feature of the model is the inclusion of a Procedures on "how to Manual, 
which allows for ease in rep-1 ication. Instruments are included^ 

♦ 

Koch, James V. A Benefit Cost Analysis "of Vocational- Occupational Training 
at Selected T TTTnois Junior Colleges . State of Illinois Advisory Council 

■■ — < — r- ~ - ■ - T7TT3 *s f 
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on Vocational Education, 1973. t 

Contained in this report are the' results of a benefit-cost analysis of 
occupational-vocational training offered at five selected junior colleges in 
Illinois. THe analysis compares* the economic benefits of such training. 
Both the view of the private individual and the view of society are taken. 

McCaslin, L. N. ; Gross, Charles J.; and Walker, Jerry P. Career Education 
Measures: A Compendium of Evaluation Instruments . Columbus: The 
National Center for Research in Vocational Education, The Ohiio State, 
University, 1981. . . 

%% handbook is designed to provide descriptions of an assortment of 
measurement instruments currently being used to assess career education 
objectives. Specifically, it includes a discussion of the purposes-, 
qualities, target populations and availability of each instrument. More 
importantly, it is hoped that the haridbook will aid the appropriate ?, 
individuals to conduct evaluations that will result in jnore. effective career 
education projects. - 
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Mckirmey, Hoyd t., MunnrbdCh, Alfred J., and Neel , CO. Central Kentucky 
Vocational Education Evaluation Keport FinaV Report . Bureau of 
. Vocational Education, Kentucky Department of Education, 1972. 

* • ° 

This document summarizes the activities carried outixy-44^ Central 
Kentucky Voca'tiortal Education Evaluation Project. Because this was a pilot 
project, special attention should .be .given to the conclusions reached and 
the recommendation* offered. Instruments are provided. 

t t 

' * i 
Marsorv, Arthi/r A.; Werner, Arthur, E.; and Sorensen, Robert P. et al ♦ Cost 
Benefit Model development .* ,Madison: Wisconsin Board of Vocational r 
Technical and Adult Education, 1977. 

The major purpose of this study was to refine a cost benefit model that 
was previously developed* and to evaluate the benefits and the costs of 
full-time vocational-technical programs. Along with refining. a model for 
fUll-time programs a cost benefit model was developed for available, 
noncredi tf'adul t education. 

The two cost benefit models were developed , refined , and tested on a 
sample of Dine fujl-time vocat.ional-teciinical programs and- on. sixty- three 
adgTt education courses. The 'programs and courses chosen refl ect,a cross- 
secti/rr of most of the instructional areas found. in vocational-technical • , 
education.. The results af this study -show that the benefits of a 
vbcationa>-technica1 education outweigh the costs. 

■ p . • * , ' ! 

As a re$u*lt of the mrie test programs and the sixty-three test. courftfiT- 
.it can be concluded that vocational-technical 'education at either af th^ 
three part-icipating schools is a profitable investment f or , both society ancf 
for the individual student. It can alsri'be concluded that usable-.cost 
be/ief it f modeK have been developed to analyze vocational-technical programs 
aqd courses.. Continued use and refinement of the these models is 
effeouragedl «* • ' 

• • •)'... ' * 

"Masker, Lt/ljruJ L. "StVatey/es for Evaluation of Postsecpriclary Occupational 
: PrpgramsV* ' The SeccW>Annua] Pennsylvania Conference on Postsecondary 
■ Occupational Education , Angelo £. Gillie; editor University Partrf p- " 
, Pennsylvania Center for the Study of 'Higher Education,. Pennsylvania! 
State University ,"J<>/1 . \ ' 

' ' This artrcle revvews the approaches, techniques, problems, and issues . 
associated with the evaluation of .ftostsecondary occupational education 
programs. . Includes sa presentation 'of both the process 'and prgcluct 
.approaches to evaluation with*. emphasis on gcjals and measurements „of, how , well 
they*hav,e tx?en niet. t % + , | * * * 
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Harris, Zelma. , and Eros, Dawn. Identification, Description and Evaluation 
of Vocational Education Programs at Metropolitan Community Col leges in 
Kansas City, Missouri Kansas City; ThS Metropolitan Community 
Colleges Administrative Center, 1978. 

Thir'docijfnent describes a vocational education curriculum evaluation 
model. The model is based upon the fol lowing criteria: * - - 

1. Program's relationship to/job market profile . ■ 

2. Program's level of occupational .community supo^rt « * ' 
3.. Program's success in meeting vocational^spiHfations of past 

* and "present students 1 

4. Program 1 s success in terms of student performance * 

5. Program's cost effectiveness 

6. Program's success in meeting the needs of handicapped 
and disadvantaged students ^ * - 

- 7. Program 1 s success in demonstrating sex fairness ■ 

Data were primarily analyzed throDgk the application of descriptive 
statistics, to produce a profile constructed so as to provide administrator 
and other interested personnel an evaluative overview of a program's C 
strengths and .weaknesses on each of the criterion measures. An outstanding 
, feature of the model is the inclusion of a Procedures on "how to" Manual, 
which allows for eaior in replication. % Instruments are included*. 




Koch, James V. A Benefit Cost Analysis of .Vocational-Occupational Training 
, at Selected" Illinois Junior Colleges . State of Illinois Advisory Council 
, on Vocational, Education, 1973. 

• Cdntained-in this report are the results of a benefit-cost ana1ysis,of 
occupational-vocational training offered at five selected junior # colleges in 
# Illinois. The analysts compares the economic" benefits of such training. 
Bot-h the view of the private individual and the view of society are taken. 

McCas^li'n, L. N. ; Gross, (ThartesJ.; and Walker, Jerry P. Career Education - 

Measures: A Compendium of Evaluation Instruments . Columbus: The 

' National Center for, Research in Vocational Education, The Ohio State 

• University, 1981. y N N * 

* * * - " " K * . < 

■ . • * * > 

This handbook is designed to provide descriptions (fa an assortment of 

measurement* instruments current ly-'being used to, assess career education 

objectives.* Specifically, ft includes a discussion of the purposes, 1 

qualities, target f>ppulations and availability of each instrument.* More 

importantly, it is hoped that the handbook wijl aid the appropriate 

individuals to conduct evaluations that will result in riiore effective career 

education projects. , ' « 
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McKmney, Floyd L\ , MdnriubdCh, Alfred J.; and Neel , CO. Central Kentucky 

Vocational Education bvdludtiOn.-feport Hrial Report . Bureau of 
' . Vocational Eduea^on, Kentucky Departme^ of Education, 1972. „ 

* This document summarizes the a6livities carried out by the Centralv 
Kentucky Vocational Education Evaluation Project. Because this was a {mot 
project, special attention should be given to the conclusions reached x and 
the. recommendations offered. Instruments are provided. 



Marson, Arthur A.;Weiner f Arthur, E.; and S'brensen, Robert. P. et al. Cost 

Benefit Model Development . Madison: Wisconsin Board of Vocational, 
s ' Technical and Ad-Olt Education, 4977.. 

The major purpose of this study was to refine a cost benefit model that 
was previously developed*? and to "evaluate .the benefits and the costs of 
full-time vocational-technical programs. ' Aldng with refining a model for 
f full-time programs a cost behefU model was developed for available!! 
noncredit adult education. ' 

The two cost benefit models were developed* refined, and tested an a v 
sample'of nine ful 1-time -vocational-technical programs and on sixty-three 
adult education courses. The programs and -courses chosen reflect a cross- 
section of most of the instructional areas found in vocational-technical 
education. The results of this study show that the benefits of a 
vdcational-technical education outweigh the costs.. 

As a result of the'oine test; programs V^uLthe sixty-three test courses, 
it can be concluded that. vocational-technical education at either of the 4 . , ^ 

three partici pating' schoql s is a profitable investment for both society and 
-for the individual student;. It elan" also 6e concluded that usable cost 
benefit models have "been" developed to analyze vocational-technical programs 
and courses. 'Continued use and refinement of the\ these models is 
encouraged.' * 

^Medsk-er, Lei and L. "Strategies for Evaluation of Postsecondary Occupational 
* Programs." The Second AnnuaVPennsyl yania' Conference on Postsecondary 

Occupational Eflucat-ibn , Angelo C» Gitlie, editor University Park: \ 
Pennsylvania Center for thp* Study of Higher Education, Pennsylvania i — 
State University, 19.71. 

\ - • , * •> " . • * * 

This article reviews the approaches, techniques, problems, and issues 
associated wit^ the. eval uation of post.secondary 'occupational education 
programs-. Includes a presentation pf both the process and product 
approaches to evaluation w4th emphases xfn goais and measurements of how well 
t£h£y have been met. - • 
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Moore, Gwendolyn B* ; Rubenstein, Sherry A.; Gortti, f Wi 1 1 i am P.vand SchuJ^f, 
Peter E. ^nnept icut. Heal th Occupation's follow-up Study , Conne cticu t 
■ State Departrftefit of Education, Division of Vocational Education, 1977. 

This' document reviews a program specific type of evaluation system. The 
Connecticut Health 'Occupations Follow-up Study, .initiated in 1977, was a 
■study, of graduatesfrw health organizations programs in 1967 and 1972* The 
study was undertakeri^tey- National Evaluation Systems, Inc;, under contract to 
the Connecticut State Department of Education. The study focused on 
information provided by the graduates, including; additional training they 
have received, past and current employment information, levels of job 
Satisfaction, perceptions oT'the quality of health occupations training and 
school information. The data are intended to provide decision makers with 
the information they need to revise curricula, review .pi acemept services, ^ 
counsel current students on the J:ypes of-work done by graduates, as well as 
many other factors- that will ultimately strengthen health occupation 
programs at the secondary and postsecondary. 1 evel in Connecticut. 
Instruments are provided. 

r 

Morris, William, and Gold, Ben K. Student Accountability Model: -Operations 
Manual Chancellor's Office, California Community Colleges, 1978. 

The* purpose of this document is to outline procedures! to gather 
information from and about students after thjeyjeave college. This data is 
considered important when evaluating present programs 'and planning for. the 
future. The Student Accountability Model (SAM) is utilized with the 
Community College Occupational Programs Evaluation System '(COPES) as part of 
the statewide community college occupational* education program evaluation 
and reporting system sponsored by* the Chancel lor's'-Off ice, California 
Community College. The following forms are jut i 1 i zed in this system: 

1. Student In-tl ass Questionnaire 

The purpose of this questionnaire is three- fold: fc 
(1) to provide necessary -information for funding 
purposes; (2) to provide the college information 
to help better meet student needs ; and (3) to be 
\ ' of assistance to the student in career planning. 



Student Follow-up Questionnaire 



4 



This form is designed tp gather data related to- 
the student in terms of employment status and 
students' percq^ions of training program. 
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e, werulolyn It. , KuhiMisiiM n , Sherry A. Gorth,. William P.;^and Schuler, j 
;>eter L. Connecticut Health Occupations Follow-up Study 
State Department of Education, Division of Vocational Ed 



_ . Connecticut 
Education, \977. 



r his document reviews a program specific type of evaluation system. The 
Connecticut Health Occupations Follow-up Study, initiated in 1977, wa^ a 
study of graduates from health organizations programs in 1967 and 1<#2. The 
study was undertaken by National Evaluation Systems, Inc., under contract to 
the Connecticut State Department of Education. The study focused bn 
information provided by the graduates, including; additional training they 
have received, past. and current employment informatioa, levels 'of job 
satisfaction, perceptions of the quality of healthy occupations training and 
school information. The data are intended to provide decision makers with 
.t*he information they need to revise curricula, review placement services, 
cuunsel current students on the types of work v done"by .graduates , as well as 
many otherf factors that will ultimately strengthen health occupation 
program the secondary and postsecondary level in Connecticut. 
Instruments are provided. - 

Morris, allium, and Gold, Ben Student Accountabi 1 Hy Model : Operations 
Manual . Chancellor's Office, California Community Col leges, 197^. ■ 

* The purpose of thfs document is -to outline procedures . to gather 
information from and about students after they leave college. This data is 
considered important when evaluating present programs and planning for the 
future. The Student Accountability Model (SAM) is util izgjWlT^Ktt^ . 
Community College Occupational Programs Evaluation SystettT (COPES) is part of 
the statewide community college occupational education' ^ogram evaluation 
and reporting system sponsored by the Chancellor's Off ice\Cal ifornia 
Community College. Jh'e following forms are utilized in t\y?s system: ♦ 

1. ' Student In-CUss questionnaire 

The purpose of this questionnaire is* three-fold: 
(1) to provide necessary information for funding 
purposes; (2) to provide the college information 
to help bett.er meet student needs, and (3) to be 
of assistance to the student in career planning. 

2. Student Follow-up Questionnaire 

* This form is designed to gather fiata related to 
the student fn terms of employment status and 
students' perceptions of tfaiping program. 
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3). Employer Fol low-Up Questionnaire 

This form is designed to gather data related to ' 
'the students program not the former student. 
As well as potential needs of the employer. 

Muirheid, Donald F., and Cronin, Joseph M. Dissemination and Use of L 

Materials to Facilitate Locally Directedlval uation of Community College 
Agricultural Occupations Programs . Springfield:- Illinois Department 
of Adult, Vocational and Technical Education, 1979. 

This evaluation guide is designed to assist local community college 
instructors, administrators, and other persons in the evaluation of their 
agricultural occupations program. The first of three sections' provides an 
introduction and discusses (1) how standards benefit students, colleges, and 
the community; (2) how to prepare for a review of the local program; (3) how 
to conduct the review; and (4) how to develop * plan for upgrading the local 
program. Section 2 contains ah example showing how to use the standards 
checklist for reviewing local programs. This section also provides lists of 
standards* approved by -Illinois community college instructors in agriculture. 
The final section includes the following field test reports: horticulture 
program- -Jol iet Junior College; agricultural supply program— II 1 inois 
Central College; agricultural mechanics program—Lake Land College; and 
agricultural production program—Lewis and Clark College. Instruments are 
provided. ?> 

Paul, KrJshan K. A Manual for Conducting Follow-up Surveys of Former 
Vocational Students . Research and Development Series, no. 106. 
Columbus: The Center for Vocational Educat ion , .The Ohio State. 
University, 1975. ■ ! . 

The follow-up procedures presented in this document are designed to 
facilitate-the collection, analysis, and reporting of information on the 
post-schooling experiences of graduates and dropouts from' vocational 
programs.. Of -particular interest is information on jobs obtained and their 
relationship to training programs, and the income, geographic mobility, and 
the satisfaction- of former students. - ■ . 



Pault^r, Albert J. Evaluation, Hints for Vocational Teachers . Chicago:* 
American Technical Society, 1977* ~ 

This document is designed 1% beginning and experienced teacfjers in both 
public and .private vocational education programs. Its basic tenet is that 
local vocational education programs can be evaluated in terms 0 processor 
product. Process refers to tlje instruction^ program*, curriculum, 
facilities; actual teaching, Is wefl as -to the community resources, and 
involvement expended. Prq.dyuct/iefers^to the ^gradyates and perhaps even to 
the dropouts of ap -educational program. *411 evaluation, therefore, centers 
on process, or^product, or'on a c6ffibirfat,ion of. both. . Sample forms for-data 
collection and tabulation are provided. 



Ponce, Uiseo R... Iranthak, Stephen J.; Billings, Robert S. K. and O'Reilly, 
Patrick A. Guidelines and Procedures: Measuring the Training 
Satisfaction and Job Satisfaction of Former Vocational Students , 
Columbus: The National^Center for Research in Vocational Education, The 
Ohio State University, 1981. 

This document has eight chapters. Chapter 1 explains the rationale, * 
development and organization of the handbook.. The next chapter is composed , 
o? two Commissioned concept papers dealing with the statVof-the art, 
problems, and issues of measuring training and job satisfaction. The 
succeeding three chapters, 4 through 6, explain the following alternative 
data collection methodologies: mailed questionnair.es, interviews, and some 
qualitative methods? Chapter 7, Data Analysis and Interpretations, exposes 
the reader to some.descri ptive and inferential statistics that are - 
appropriate in analyzing and interpreting data on training and job 
satisfaction. The final chapter, expjains some, strategies for data 
presentation and utilization. 



Professional Review Program for Faculty . Tri ton ,Col 1 ege , River Grove, 
I1 1 1 noi s. . 

The purpose of the professional review process outlined i n y thi s document 
is primarily formative, designed to maintain teaching effectiveness and to . 
promote instructional improvement. It 'consi sts^ of the following components: 

1. Instructor Sel f-Lvaluation e 
, 2. Student Evaluation 

3. " Peer Evaluation * 

4. Department Chairperson/Coordinator Evaluation 

5. Administration Evaluation^ , 

The comprehensive nature of the evaluation program is based on the 
belief that several components used together, each of which examines a' 
different aspect of teaching or views the teaching/learning process from a 
different perspective, is preferable to the use of any single component. 
Instruments are provided for each of the five areas described above. 

Robertson, Marvin J. Facilities Evaluation in Vocational an<jy Technical 
Education . Col umbuTi ERIC Clearinghouse for Vocational ^md Technical * 
Education, The Center for Vocational and Technical Education, The Ohio 
State University, 1973. . . \ ' 

The purpose of this publication- is to present information rel.ative to 
the evaluation of "fac i 1 i ties for vocational and technical education 
programs. Selected reviews .of material relevant to facility evaluation are 
included. Much of the literature cited, relates to original planning of' 
facilities or to evaluation of educational facilities in general. 
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Spirer .Janet E. The Cast' Study Method: Guidelines. P ractices and ^ 
Application* for Vocational Educa tion Evaluation . Cnlumh.K- ~R,tinn,i 
Center for Research in Vocational Education, The Ohio State University, 

' * « 

Vermont Vocational Educ ation Programs Quality Assessment Sv stPm. 
Montpelier, Vermont: ^State Department of Education, Division of 
Vocational -Technical' Education, 1979. 

" This document outlines an evaluative system designed to examine the 
following components as they relate to the quality of vocational education 
within Vermont. 

1. Follow-up of Program Completers 

2. Survey of Employer Satisfaction 

3. Assessment of Student Competencies ■ 
■ 4. Services provided to Students 

The quality assessment system described in this document has these 
d-istinct phases- Phase I : a self-study prepared by staff, lay people and 
students. Phase II: reporting the results and recommendations to the State 
• Bo^rd for .Vocational Education through the State Director of Vocational 
•Education. t Example instruments are provided. 

Stromjdorfer., Ernst W. Review and Synthesis of Cost-Effectivenes s Studies - 
• of Vocational and Technical Education . Columbia tRlt Clearinghouse on 
.Vocational and ie,chmcal Lducation, The Genter for , Vocational and 
Technical Education, The Ohio- State Uni vers ity, "1972. 

.This document synthesizes the various approaches to improving the 
analysis of vocational, education and. related human resources training 
programs. ..This is an economic analysis since the programs in question are 
designed to improve the efficiency of the United States labor' force and 
increase the overall level, of welfare or well-being in the most general 
sense of this term. In addition the implications of the noneconomic 
benefits to these programs. as they relate to cost-benefit analysis are al'so 
_ discussed. Both cast-benefit and cost-effectiveness studies of vocational 
•education and rela/ted human resource programs are summarized to determine 
the current state| of the art" an<Pto draw policy conclusions concerning the 
optimal level of investment in such programs. 

' • ' . ■ 

•* . ■ 

' TEX'-SIS Student Follow-Up. Fortworth, Texas: .Project Follow-up," Tarrant 
. County Junior. Col lege, 1976. * 

1 i 

• The .student information system (SIS) was developed primarily to be 
utilized by the. Texas community and junior colleges. SIS is composed of a 
series of fourteen d^ta collection devices developed^'and tested in a 
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. multitude of different environments in various colleges across Texas; SIS, 
is built upon the concept of an educational management Information system/ 
it is divided into the following seven subsystems, each with it's -own 
instrument s), and method of processing., . - 

Subsystem I—Student's Education Intent 

2 stem IN -Withdrawal, Follow-up . ; 

.stem III— Nonreturning Student Follow-up^ 
Subsystem^ IV-^Gratfuate Follow-up 
"Subsystem V— Employer Follow-up 

Subsystem VI— Adult and Continuing Education Follow-up 

Subsystem VI I--State follow-up -Reporting- 

• • i * * 

Tom, Frederick T. K. , and Cushman , Harold R. "The Cornell Diagnostic 
Observation, and Reporting System for Student Description of College 
Teaching" New York: Cornell ^University, 1975. 

The,purpose of this form is to allow students to provide information 
that will assist instructors in improving their teaching. The form requires 
demographic information about -the student in. terms of sex, academic 
standing, and if the course being evaluated is required Or elective in 
nature. .Students provide'information in relationship to the teaching 
ability of the instructor, and perceptions of the*student related to the 
progress in the course being eval uated- r<*l at i ve to other courses that have 
been taken at their college or" university. The instructor ranks the general 
teaching -objectives utilizing the following instructions:' 

Read careful the following seven general teaching 'objectives for 
undergraduate courses. Rate each in terms of its importance for this 
section of your class, using the code that .follows: »■ 

• 1. Not 'important * - * 

2. Of no more than minor importance * * . 

3. JmpoVtant ' 
4i Very important / 

5. Absolutely essential ' ' 
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Circle one: 
1 2 3 4 5 

1 2 3 4 5 



2 3 4 5 



1 2 r 3 4 -5 

1 2 3 4 5 

1 2 3 4 5 

1 2 3 4 5 



General Teaching Objectives". - ' 

1. Gaining factual knowledge (terminology, 
classifications, methods, trends). / 

2. Learning fundamental principles , 
concepts, or theories* 

3. Improving logical thinking, problem- 
solving, and decision-making abilities. 

4. Developing specific psychomotor 
(manipulative, manual) skills. 

5. Developing a favorable attitude toward 
the subject matter. o 

6/^ Developing creative '( imaginative , 
inventive, original) capabilities. 

7. 'Developing skrlls in organizing ideas 
and presenting them in written and oral 
forms . 



The computer is then ,uti 1 i zed to provide the instructor with a printout 
that relates these criteria to the appropriate questions on the evaluation 
form. 

\ V 

Trident Technical 'College, P.O. Box 10367, Charleston, South Carolina 29411 . 

This* institution utilizes the following format to evaluate its 
vocational education programming: 

Studfco^s - from this source information is gathered concerning 

curriculum, instructor performance and current and past 
employment status 

Employers - -information related to students performance, curriculum, and 
potential needs are gathered from this source 

Administrators - provide information related to -staff and . 
• . ■ administrative performance 

This system is well suited to Trident Technical College. 

• •> » 

Troutman, Frank H-.; (Jreshears, Sarah G. ; and Newbery, Jane A. Evaluation of 
Arkansas Vocational Training Programs in Relation to Economic 
Development: Part' II - Survey of Vocational Schools' Performance , 1969. 
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This is the second report on a three-part study of Arkansas 1 vocational 
training, needs as they relate to the State's economic development problems. 
It was undertaken as a result Qf widespread recognition, by both public 
■officials and private business leaders, that a more carefully planned 
strategy for vpcational education efforts is necessary if economic growth in 
Arkansas is to reach its maximum potential. % * 

The results of this 'study are presented fn three reports: 

Part I--Occupational Needs and EmpToyment Projections. 

Part~ IT— Survey of Vocational Schools 1 Performance 

Part 1 1 I--Eval uat ipn of Programs and Recommendations. 

i 

The, objective of this survey was to obtain useful information on the 
State 1 s existing schools and training programs. It was undertaken to aid in 
evaluating and improving vocational educat ion , .not to find fault pr to 
censure. The results presented in this document are a combination of 
information from a mail survey of former students, face-to-face contacts ^ 
with students, teachers, and administrators and interviews with numerous 
empl oyers . 

The* procedures followed on this evaluative effort are intended to serve 
as a guide for continuing appraisal of human resource training programs. It 
is especially -important that a continuing student follow-up system be 
established. 

< * • 

Ward, Charles f/' The State of Accreditation and Evaluation of PoStsecondary - 
. Occupational Education in the United States" Center for Research and 
, Development Report, no. 12. North Carolina State University at Raleigh, 
Center for Ocu^tional Education, 1970. 

This document outlines the developments organization, and procedure^Bf 
the regional, specialized, and governmental accrediting agencies -in Uie _ 
United States. The arguments .for* and aga-inst separate accreditation for 
occupational education are discussed. Because- of the rapid growth of 
occupational education, problems still exist^in judging its effectiveness. 
The discussion concludes with suggestions for future action on the part of 
all accrediting agencies. 
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Will iamsport Area Community College. Program Evaluation . Wil 1 iamsport , ,PA: 
Williamsport Area Community College, 1 980 T z 

This program evaluation system provides procedures and data collection 
instruments. It contains guidel ines, objectives, criteria for evaluation, 
and implementation strategies. Data are galfhered frgm graduates, graduates 
who transfer to tfour-year programs, faculty of four-year institution^ to 
which graduates have transferred, employers of graduates, students wno are 
currently enrolled, and students who are about to graduate* In addition the 
college also has an instructional evaluation procedure. 




